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SOME GENERAL OBSERVATIONS AND EXPERIENCES IN LOGISTICS 


Robt. B. Carney, Admiral USN (Ret. ) 
The George Washington University Logistics Research Project 





The author, recently retired after a distinguished Naval career, 
discusses the impact of logistics on high-level planning. 











This dissertation on logistics represents my personal views and reflects experiences 
and conclusions reached over a period of years; from time to time, my own conclusions under- 
went alterations as added experience broadened my views and understanding. First, a few 
observations concerning my experiences in the logistical field in World War II might be of 
interest. 

In February 1941 I was ordered to report to the Navy Department where I found an 
atmosphere of secrecy and mystery concerning my own assignment. Eventually I reported to 
Rear Admiral Bristol who had been designated the ''Commander Support Force."" That this 
name was deliberately misleading will be understood when I say that the mission of the Support 
Force was to organize, equip, and train a force for early participation in the protection of 
shipping. Mind you, this was in February 1941—ten months before Pearl Harbor. Briefly, the 
concept of operation was the establishment of a force which would operate from bases in the 
North Atlantic for the protection of shipping by the escort of convoy, by certain air operations, 
and by port protection. The Navy was in no respect ready, material-wise, to put such a concept 
in operation, and even a cursory study of the problem pointed out clearly that we would need 
such things as tank farms, hospitals, water-front facilities, ship repair units, air repair units, 
and a host of other things involving materiai not on the shelf and personnel as yet untrained. 

The problem itself at least indicated an organizational solution, which eventually 
resulted in my being designated as Officer in Charge of Plans and Operations—perhaps the 
first time this combination had ever been employed in the Navy. 

For many years the Navy had been so obsessed with the tactical aspects of the Battle 
of Jutland that little or no attention had been paid to the thinking and the planning that was 
involved in a sustained campaign wherein losses were affected by incremental attrition, rather 
than by the holocaust of the major fleet engagement. Consequently, the Support Force staff 
started from scratch in its planning and its accumulation of equipment. 

It is of interest to note that when the Japs struck at Pearl Harbor on the 7th of Decem- 
ber 1941 there was no accumulation of equipment for the establishment of an advanced base in 
the Western Pacific and, in order to fit out the first base at Bora Bora (known as "Bob Cat" in 
the code parlance), it was necessary to commandeer the base-development equipment which 
had been accumulated by the Support Force for the building of its North Atlantic bases. It also 
is of interest to note that the Support Force representative in Washington, Captain W. A. Corn, 
had worked out a sort of catalog of components for advanced bases — the first document of its 
kind in the Navy. 

For a time I had a respite from these matters while commanding the USS DENVER. 
Then, in July of 1943, I was ordered to report to Admiral Halsey as his Chief of Staff. At that 
time the most significant deficiency in the entire organization of the South Pacific was lack of 
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adequate coordination of logistical planning and logistical control to conform to the require- 
ments of the approved plans, and to the support and maintenance of the operating forces which 
frequently were engaged in surprise operations for which no plans had been made nor could 
have been made. It was here that the full impact of the importance of logistical planning from 
top to bottom became apparent to me. We set about developing a carefully integrated system 
of headquarters planning and contro) which would marry strategic and operational require- 
ments with the realities of logistics; to a reasonable extent we accomplished this marriage 
within the South Pacific,area, but it became apparent to us that what happened in the Joint 
Chiefs of Staff, and what happened in the various civilian agencies for control of our industry 
and resources, all had a dynamic effect—or perhaps a negative effect at times—on the affairs 
of the South Pacific. 

Later, when Admiral Halsey went to command the operations of the Third Fleet in the 
Central Pacific, our attention was turned to mobile logistical support, and I received a good 
education in the floating advanced base concept and the mobile logistics support attending the 
forces at sea. 

Although I spent from June 1940 to December 1945 with the operating forces, much of it 
with the combat forces, I returned to the Navy Department after the war with a profound con- 
viction that line officers had to get into the logistical business, get into it quickly, and get into 
it in a big way. I sought appointment as Deputy CNO for Logistics and welcomed the opportunity 
to tackle that job even though I thoroughly recognized my own inadequacy. 

One of the first things which came to my attention was the almost complete lack of 
senior officers who were broadly qualified in the philosophy, concept, and operations of the 
logistics business. They could virtually be named on the fingers of one hand; there was, of 
course, Admiral Horne, who had evolved as the virtual coordinator of the entire logistical 
operation of the Navy Department in support of the operating forces; there was Admiral 
Badger, who had been associated with the beginnings of a systematic organization for the per- 
formance of the logistical function in the form of what was then known as OP-12; there was 
Admiral (then Captain) McCormick, who had also served in OP-12. There were certain offi- 
cers who had specialized experience in personnel, in the specialized aspects of aviation, and in 
other restricted fields; there also were officers who had served with the Service Forces, par- 
ticularly in the Pacific, who had a keen understanding of the requirements in end-products but 
had not rubbed shoulders with the shore establishment aspects nor the problems of procure- 

ment. Considering that the best operational plan in the world is no better than the logistical 
support that it receives, and considering the vast material implications of the Navy's expansion 
and the campaigns that it had waged, it is extraordinary that there had been so little appreci- 
ation among the line personnel of the vital importance of the great science of logistics. Never- 
theless, the dearth of qualified personnel was a real one. 

Early in 1946 I set about organizing in OPNAV for the performance of the various 
logistical functions for which the operating people were responsible, and I placed particular 
emphasis on obtaining and training senior Captains and Flag Officers in these responsibilities. 
At the end of four years, by my own reckoning I had put about 18 Flag Officers through the mill 
so that the Navy was in far better position in that respect than it had been at the end of the war. 
With a reservoir of 18 Flag Officers and a great many highly competent Captains who had 
served in OP-04, the operational future, logistics-wise, was assured. 

It was also necessary to emphasize the fact that the selection for promotion process 
was not ignoring those who had served well in the logistical fields; a consistent effort was made 
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GENERAL OBSERVATIONS AND EXPERIENCES IN LOGISTICS 





to impress the importance of logistics on all hands to the end that the Selection Board members 
would regard logistics as an essential function of operations and would give careful consider- 
ation to those who had performed well in the logistical field. I consider that a working com- 
petence" in logistics is a requisite part of the professional competence of all unrestricted line 
officers. I consider it a requirement for high command, and I also consider it a requirement, 
in appropriate measure, in the lower ranks. The results of this effort were reflected in an 
increasing number of "logisticians'' being selected to Flag rank. I felt that my own selection 
as CINCNELM and subsequent appointment as CINCSOUTH and Chief of Naval Operations 
should have served as an encouragement to those who performed in the logistics bailwick. 

Next, let me say that the word "logistics'' seem to have sprung into being, full-grown, 
from the dragon's teeth of the urgent needs of war. Curiously enough — right up until now — 
there is nothing which even approaches a universal understanding of the full meaning of "logis- 
tics;" this is true in the Navy and throughout the entire governmental structure. There is a 
formidable body of opinion which regards "logistics'' and "supply"' as interchangeable, and 
many otherwise well-informed military men still regard logistics as something which should 
be sloughed off onto the technical people and the commercial experts. Among the operating 
personnel there is still a lingering suspicion of logistics and some feeling that to be identified 
with logistics is to receive the kiss of death. Actual’, logistics is an all-hands responsibility, 
and no officer who aspires to high naval operating c: amand can be considered properly quali- 
fied for such responsibility if he does not have a firm basic understanding of the importance of 
logistics and the organization by which logistics is administered. 

Logistics is a subject on which volumes could be written, the more so because there is 
a persistent unwillingness, or inability, to place "logistics'' and "supply" in proper mutual 
relation and proper perspective. The error has been compounded and perpetuated in the desig- 
nation of the Office of the Assistant Secretary of Defense for Supply and Logistics; that title is 
a misnomer and has the tail wagging the dog. 

The distinction between logistics and supply is implicit in a definition evolved by the 
George Washington University Logistics Research Project: "the process of planning for and 
providing goods and services.'' Logistics is the entire system of planning for and providing 
; goods and services; it is a campaign which begins with the statement of requirements, proceeds 
4 through the business of procuring and only ends with final distribution. Perhaps one might say 
that it does not even end there, because there might be storage and preservation problems at 
the very end of the line rather than utilization in the sense of being consumed or stricken from 
the inventory. Aspects of logistics include personnel, transportation, supply, medical, main- 
tenance and repair, construction, storage and other specialties, but they all are part of the big 
logistics picture. In addition, the solution of a logistic problem has the management aspects of 
organization, planning, execution and supervision. The whole process calls for the efforts of 
the operational forces, the military men of all groups and corps, the shore establishments, 
participation by civilian executives and technical people in the departments, and the best brains 
of industrial management, design, and production. Regarded in this light, it is perfectly evident 
that "supply" is but one facet of the greater function known as "logistics." 

An inspection of the sequence of events involved in preparing for any military operation 
of whatever size clearly points up the fact that it is an all-hands problem. Be it a small patrol 
operation or a major campaign, two things must be placed in balance before the operation can 
be undertaken with any hope of success: objectives and feasibility. The military planner out- 
lines those things which he would like to accomplish—his objectives; these objectives are then 
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tested against the capability of our side to produce the men and material initially needed, and 

to produce the replacement men and material required for the prosecution of the operation to 

its ultimate success. The establishment of this balance is imperative, and procedures must be 

established at every level for its accomplishment. ‘4 
I have always visualized naval logistics as a dynamic flow system, not only of men, , 

goods, services, etc., but as a planning and executive effort. This thought did not originate 

with me, I am sure, because I found it, piecemeal, in the minds of many people as I studied 

the problem immediately after the war. But I may have rendered some service to the cause of 

logistics by pulling the variously related ideas together and preaching them as one system, or 

flow. 








As a distinction between the purely military phases of logistical planning and those 
steps which must be performed by technical personnel in the military establishment and by the 
industrial suppliers, the expressions "producer logistics" and "consumer logistics" have come 
into common use. On close examination, however, the process does not lend itself too well to 
division into two clearly defined and separate processes. Rather, the flow of events resolves 
itself into three phases: (1) the statement of requirements, (2) procurement, and (3) distri- 
bution. There is some measure of fuzziness even in this division, but it appears to better point 
up the actual steps. ; 

The statement of requirements is primarily a military function—tabulating those things 
which are needed to successfully carry out the strategical and technical plans. Procurement 
is the process which involves a translating of military requirements into technical specifications 
and the actual production of those things which are needed, either by industry or by the facilities 
of the Department of Defense. Distribution is a process which begins when items are completed 4 
and ready for use; it may be considered to begin at the end of the procurement phase but ulti- 
mately laps over into the military operation. In the case of fuel, the final disposition is up the 
stack; in the case of bullets, the final stage of distribution is through the muzzle. From this it 
can be seen that the operating personnel are vitally concerned with the first and third phases 
which therefore automatically become essentials in the operating business. 

As stated before, logistics is a subject of direct concern from the smallest field unit 
right up to the national government level. Each level has its own problems of determining 
objectives and feasibility; although differing in degree, each level must concern itself with a 
statement of requirements, procuring the things that are needed, and distributing them in con- 
formance with the operating plans concerned. This had always been recognized to some extent 
by the operating forces and in the individual departments, but in the security law that was 
passed in 1947 the drafters took cognizance of the fact that there was a national level at which 
strategic and logistical planning must be carried on to the end that national policies and national 
objectives are feasible in terms of the national resources available. This was clearly indicated 
by the creation of the, National-Security Council and the National Security Resources Board. 

Had the National Security Resources Board developed as envisaged by the drafters of 
the 1947 law, the government would have had, at the top level, an agency for handling the 
national logistical problems in terms of its major human and material resources. Actually, 
extraneous political factors prevented fruition of the plans for the National Security Resources 
Board, and it atrophied to the point of being disestablished; instead, the Munitions Board of the 
Department of Defense initially performed many of the functions which should have been under- 
taken at the national level rather than the level of the Department of Defense. Later, the 
national logistical functions was placed in the Hands of the Office of Defense Mobilization. 
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GENERAL OBSERVATIONS AND EXPERIENCES IN LOGISTICS 


There was still one more level which had to be considered; I pointed this out in a 
speech in May of 1950. Ultimately it would be necessary for the freedom-loving nations to 
band together in their own mutual defense and, at that time, in addition to the problems of 
grand strategy, it would be necessary to enter into arrangements for considering the "grand 
logistics" of alliances. In other words, there was in the offing an international logistical prob- 
lem. This all came to pass in the creation of NATO. 

In summary, it is essential that officers assigned to the high planning, administrative, 
and command positions have a working understanding of the economic-logistic relationship at 
the top military levels and the lateral and higher levels in other agencies of the government 
concerned. Otherwise, the Navy will lose its shirt, and perhaps its pants as well. 

Before proceeding to the planning system, it would be well to mention briefly the impact 
of "unification" on the business of logistics. Late in the war, great momentum was generated 
for a philosophy that the Services should be "unified."" No one knew just exactly what "unifi- 
cation": meant, but certain of the claims of its proponents had powerful appeal and secured a 
tremendous weight of public opinion support. Because the proposal was not without great 
danger to certain fundamental principles to which the Navy adhered, the Navy in general 
strongly opposed the general philosophy of unification; however, even at that time, I considered 
that the Navy's views were as negatively extreme as were the views of the Army and the Air 
Force and certain civilian elements extreme in the direction of merger. That battle is history 
and need not be reviewed here except to say that the profligate expenditure of the nation's 
human and material resources during the war was such that sober thought should certainly 
have dictated the adoption of whatever measure of consolidation could be achieved without 
detriment to the efficiency and flexibility of the operations of the fighting forces. Perhaps the 
pendulum has swung too far in the direction of "merger" with respect to logistics, but on the 
other hand much has been accomplished under the unified direction of the Department of Defense 
which could never have been achieved solely on the basis of obtaining voluntary agreements and 
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voluntary submerging of service autonomies. In any event, a pattern of top level control at the 
level of the Department of Defense has been established; the Services must accommodate them- 
selves to that pattern even though they should, I believe, strongly resist the current tendency to 
reach down into segments of the several departments without reference to the men responsible 
in those departments, and thus by-pass the proper authoritative chain of command; this tend- 
ency is real, it is extensive, and it could be fatal in time of crisis. 

Much has been said in the past 15 years concerning joint service procurement and its 
ramifications. First, I would like to emphatically veto any proposal for a fourth Service of 
Procurement. This idea has reared its head in many different forms over the past decade, and 
I am afraid that in certain categories of procurement it has already come to pass in the vesting 
of over-riding authority in certain divisions of the Department of Defense. Nevertheless, it is 
fundamentally unsound to place control of the quantitative, qualitative, and priority aspects of 
procurement in the hands of a Service not responsible for the outcome of military campaigns. 
For a long time important elements of the Army and Air Force supported the philosophy of a 
fourth Service of Supply, but for the most part they seem to have come to see the picture in the 
same light as viewed by the Navy. 

There may be some merit in single service procurement in which one Service is desig- 
nated the responsibility for procurement for all three other Services. However, it is expecting 
iy too much to believe that one Service could altruistically accord priority to a sister Service o. 
an item which enjoyed high priority in its own list of needs; to some extent this factor of human 
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weakness can be overcome through the use of a working fund to which contributions are made 
by each Service and against which withdrawals can be made while credit exists. This device 
is employed with reasonable success in the operation of MSTS, each Service being able to order 
services as long as its credit is good in the working fund. It is my own belief that certain items 
can best be procured for the Department of Defense by a single Service provided that (a) design 
and specifications are satisfactory to all users and (b) that each Service budgets for its own 
needs, placing appropriate funds at the disposal of the Service designated for the single pro- 
curement job. 

I would like now to speak concerning the planning system. I believe that the planning 
system which is in effect in the Navy Department is essentially sound and sufficiently flexible 
to accommodate itself to changing conditions. Detailed information on this planning system is 
readily available and need not be covered here except to mention two very important aspects of 
the philosophy of the system. 

Before the present system was first put into effect, there was one defect which fre- 
quently manifested itself: there was a tendency on the part of each planner, at each stage, to 
insist on the completion of his own particular step in the planning sequence before releasing 
his efforts to those in charge of the next step. This entailed unacceptable delays—delays so 
great that by the time the last step was completed those in charge of the first step were busily 


engaged in revision. In other words, the production of a completed plan was virtually impossible. 


This led to the concept of "concurrent planning" which I conceived and put into operation in the 
Navy Department planning system. The principal of concurrent planning is simply one of keep- 
ing the planners of the preceding and successive phases informed as to the development of the 
plans to the end that, by continuing consultation, the best thinking on cause and effect is con- 
tinually available in the development of each step in the planning sequence. 

The other concept which is worthy of note is that of the General Planning Group. The 
General Planning Group, functioning directly under the Vice Chief of Naval Operations, having 
representation from every activity in the department, provides a clearing house, at the working 
level, for planning. It not only is of inestimable help in the preparation of strategic and logis- 
tical plans, but it also serves as the focal point for the developing of the budgetary plans by 
which we tailor an optimum naval establishment within the means at our disposal. 

Based on my experiences with logistical planning in the field during the war, and on the 
reviews that I made when becoming Deputy Chief of Naval Operations for Logistics after the 
war, the inevitable conclusion was that there had been considerable excessive procurement; 
this, taken into consideration with the realization that the United States could not afford to 
repeat such profligacy, pointed to the urgent need for a system of logistical planning which, 
while providing adequately, would obviate waste of our precious resources. The programming 
for a campaign when conducted manually involved unacceptable delays; the introduction of 
business machines into the process was an improvement but still did not meet the demonstrated 
requirements for speed, nor could they adequately integrate all of the numerous and complex 
factors which had a bearing on the calculations and the final figures. Obviously, the problem 
was now too complex for the human mind to comprehend and handle within a reasonable time; 
therefore, some entirely different system was required to meet the demands of speed and con- 
servation. These inexorable facts and conclusions led me to believe that recourse must be had 
to the capabilities of electronic computation which were even then under study at the Special 
Devices Center and at various laboratories. 
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Having come to that conclusion, I proceeded to mobilize thinking on the subject; the 
response was spotty because there was not universal grasp of the magnitude and gravity of 

the problem, nor did any of us see how the factors of a problem could be fed into a machine 

nor how the reaction to the machine could be interpreted in concrete terms. Nevertheless, 
largely as a result of interest by the Office of Naval Research, a general conference was set 

up for the purpose of discussing the problem and the possibilities for its solution. This con- 
ference was attended by operational and technical people interested in logistics, electronic 
experts, mathematicians, representatives from the Bureau of Labor Statistics, representatives 
from the Department of Commerce, and representation from every agency having a natural 
interest in any of the three phases of logistics, namely, military requirements, procurement 
(including national resources), and distribution. These discussions produced unanimous agree- 
ment among the scientific personnel that the construction of an appropriate electronic computer 
was feasible. 

Such was the genesis of the Logistics Research Project set up at The George Washington 
University, and it was from these beginnings that the ONR Logistics Computer evolved. Mind 
you the above conference took place in the Spring of 1948, and since then many types of general 
and special-purpose, high-speed, electronic computers have been developed and have become 
commercially available. 
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e. High-speed electronic computers are relatively a new tool of wide applicability. Their 
utility is, of course, important to the military for at least two reasons: 
(a) Many service problems, both operational and logistical, involve the handling of large 
3 masses of data routinely. ' 
. (b) Many unsolved military problems which can be subjected with profit to scientific 
4 research involve in their solution the handling of complex mathematics which can be most 
j readily manipulated by modern computers. 
Computers are by no means confined in their application to service matters. It is true 
H that initially their use seems to have been generated by emergency needs, but as their utility 
es developed their application to other fields also developed rapidly. The specific Logistics Com- 
puter was developed io serve the particular need for a planning tool to handle voluminous data 
and for time-phasing logistical requirements. It is a good example of "specialization" in the 
computer field. 
The present have-not position of our country with reference to critical materials and 
qualified manpower is serious. These shortages are being continually accentuated in ever 
greater degree by reason of the complexity of the weapons and equipments of our era. Profli- 
gacy in the utilization of scarce material or the employment of highly skilled manpower 
required to fabricate the modern sinews of war is so serious as to have connotations of early 
y defeat — it is as serious as that. This fact, coupled with the demonstrable inability of manual 
d 3 and mechanical machine methods to handle modern complex programming, points inevitably to 
the need of something better, and the only obtainable improvement appears to be through the 
medium of electronic computation. 
With the introduction of atomic weapons, thinking went hay-wire for atime. As the 
possibility of the tactical use of atomic weapons dawned on military and other thinkers there 
was a further flurry of wishful and incorrect thinking. It has been very difficult to dispel the 
idea that the push button will decrease the logistical requirements of war; and yet early studies 
which I conducted while commanding the Southern Forces of NATO indicated to me that the 
introduction of tactical atomic weapons would increase the logistical demands on ground forces 
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by reason of the vastly increased requirements for dispersal and mobility. In other words, 
overhead would be increased by dispersal; transportation requirements would be vastly 
increased; and the maintenance required for increases of transportation equipment, increases 

in the number of depots and dumps, and the vastly increased number of highly trained technical 
personnel would all throw an even greater logistical burden on the ground forces. What was 
true of the ground forces also was true of the air forces. And now the naval forces are begin- 
ning to feel the impact of that problem. 

Atomic weapons, atomic powered planes, and atomic powered ships all radically and 
seriously boost the cost of those weapons, planes, and ships. Perhaps the new problems 
introduced by the advent of utilizing the atom may not be new in the mathematical sense nor 
in the required functioning of the machine, but it is certain that many new factors must be con- 
sidered in preparing military forces for combat operations, for sustaining them in combat 
operations, and for the prosecution of major campaigns. These complexities only emphasize 
the need for the development of essential data and for the feeding of that data into high-speed 
computers. 

Here again I consider it imperative that the attention of top-level leaders be focused on 
the potential value of high-speed computers to the end that they can exert the necessary pres- 
sure and guidance to insure proper interest and support at the working levels. 

I now come to my last point: the logistical aspect of NATO and ANZUS. I think that it 
would be safe to say that we could disregard the ANZUS for the time being; the nature of that 
treaty is such that there is a clear responsibility for the forces to be logistically supported by 
their own national organizations. Whatever might be gained by mutual arrangement would, of 
course, be so much velvet. For example, port facilities, provisions, etc., might be furnished 
by our Pacific neighbors, while we in turn furnished oil for the common use and performed 
such other services as were within the capabilities of our own existing forces and logistical 
support. In other words, the ANZUS organization is a loose one, and although there has been a 
certain amount of continuing planning, the nature of the geography and the composition of the 
forces that would be involved are such as to minimize the current importance of the logistical 
problems from an alliance standpoint. 

In NATO the situation is quite different. There are several factors which enter into the 
problem, and these factors can at least be named, although it is not practicable to elaborate 
here. Although there is a tacit understanding that each nation will furnish that which it is best 
able to furnish, there is also a conflicting conviction on the part of the partners that individually 
they cannot afford to completely neglect any component, for to do so would be to destroy the 
national balance which each would like to maintain. The maintaining of balanced forces within 
each national structure is obviously impracticable because of the costs involved, and it is 
equally obvious that special contributions should be made by certain countries that are capable 
of making them. For example, the small nations must relyi on the United States primarily for 

strategic air support. The same is probably true for tactical air support although some of the 
larger partners can make their contributions. On the other’ hand, we expect our European 
partners to supply the bulk of ground forces numerically. 

Next comes the problem of standardization. Efforts have been made in this direction, 
and are continuing; but as long as there is a heterogenous collection of weapons in the NATO 
arsenals, the problems of resupply are in some cases virtually impossible of solution. 

Then there is the question of stockpiling. Frankly, there is not sufficient ammunition 
and equipment stockpiled to permit continuation of combat beyond a certain point — and that 
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GENERAL OBSERVATIONS AND EXPERIENCES IN LOGISTICS 





point comes uncomfortably soon after D-Day. What then is the answer? Increasing stockpiles 

overseas is an easy and obvious answer, at least statistically; however, there are military 
disadvantages as well as budgetary hurdles which make such a program virtually impossible 
of accomplishment. 

Next comes the ever-present specter of budget. Increases of military expenditures 
have been dynamite in the European countries since before the meeting at Lisbon in early 1952; 
the politicians are unwilling to raise the ante in their own countries. On the other hand, people 
of the United States have become increasingly reluctant to provide military aid on items possibly 

’ within the capabilities of our neighbors and allies to supply. The result has been an impasse 
which affects NATO military readiness adversely and seriously. 

The net result of all of this, in NATO, is that the factors of the problems are well 
known, the problems can be accurately stated, but the solutions to many major problems and 
their components remain unsolved and very probably many will continue unsolved. 

The determination of requirements has been well handled, and I believe that the require- 
ments are accurately known and have been accurately compiled and promulgated. The procure- 
ment phase of NATO logistics, if not bogged down, is at least very materially slowed down. 
Procurement is a complicated process dependent upon negotiations which invariably have a 
political flavor and are profoundly affected by international arrangements of an economic 
nature; strategic distribution presents few problems at this time; distribution in the commu- 
nications zone is again affected by many political considerations; distribution in the combat 
zone must inevitably come under the combat commanders although at present there are political 
restrictions which are only waived reluctantly during actual maneuvers. 

In conclusion, I desire to emphasize that logistics is the entire system of planning for 
and providing goods and services for the support of the Military forces. It is an all-hands 
maneuver. The whole process calls for the efforts of the operational forces, the military men 
of all groups and corps, and the shore establishment, participation by civilian executives and 
technical people in the departments, and the best brains of industrial management, design, and 
production. 


a RS ite ict 


Supply is only one phase of logistics. By placing "logistics" and ''supply" in proper 
mutual relation and proper prospective, a more universal and firm basic understanding of the 
importance and scope of logistics will ensue. 

Logistics is an essential component in the qualification of officers administering top 
command and the important segments of the naval organization. 


“yw 


Ny The present Navy planning system is essentially sound and sufficiently flexible to 
accommodate itself to changing conditions. It is an integrated system of planning and control, 
which marries strategic requirements with the realities of logistics. 

. I would like to emphatically veto any proposal for a fourth Service. It is fundamentally 


unsound to place control of the quantitative, qualitative, and priority aspects of procurement in 
the hands of a Service not responsible for the outcome of military campaigns. 

I consider it imperative that the attention of top-level leaders be focused on the potential 
value of logistics research, and particularly to high-speed computers, to the end that they can 
exert the necessary pressures and guidance to insure proper interest and support at the working 
levels. This is the only answer to the present have-not position of our country in respect to 
shortages in critical materials and qualified manpower. 
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SYSTEM ANALYSIS AND/OR COMMON SENSE 


Commander Yngve Rollof 
Royal Swedish Navy 





The author discusses the role of scientific methods in the design 
and evaluation of military systems. 











Nowadays there are often many different possible solutions to a technical military 
problem. Therefore, systematical methods have been developed which can be employed to 
solve such problems analytically and to establish technical data for weapons which will be 
optimal should the problem situations arise in real life. In order to be able to group together 
the requirements of a weapon, it is necessary that the study be based on a correct evaluation 
in which exact technical analysis is linked together with sound judgment and common sense. 
The essence of the procedure is to reduce the uncertain factors as far as possible by means of 
scientific systematics and due respect for facts. In the long run, it is profitable to expend con- 
siderable competent effort on an unbiased analysis instead of possibly making ill advised use 
of existing limited construction capacity for weapons that subsequently may be of limited value, 
The time is past when improvisation can save what is lacking in foresight! 

The concept, system analysis, implies that a weapon system should be seen as a whole 
and not as a collection of different units. For instance, the tank, the destroyer, or the fighter 
is a weapon carrier, and its separate fighting equipment must always be considered in relation- 
ship to all the other fighting units. In short, the analysis is raised to a higher level than that 
applicable to an isolated weapon or vehicle. System analysis, like other forms of operations 
research, gives information about the measures leading to the best result under specified cir- 
cumstances. An analysis of causes, reasons, and connections serves to replace subjective 
opinions with accurate facts. A scientific operations analysis is made by means of different 
mathematical methods. Although advanced mathematical methods may be required, many 
problems can be solved by very elementary mathematics. 

The procedure for system analysis cannot be generalized. Every problem requires its 
special methods of solution. However, an attempt is made below to describe a principal pro- 
cedure for system analysis. 





PRIMARY VALUES ; 

First, all available information about the problem must be collected. However clever 
is the mathematics used, the result of a mathematical analysis is never more accurate than its 
basic figures. One never gets a better result by using more decimals than are justified by the 
underlying data. As the German expression goes: "Die Genauigkeit kommt ja erst mit dem 
Logarithmieren.'' One must try to judge the reliability of the basic data and also to estimate 
the limits which it imposes on the accuracy of the mathematical values derived from them. 

The quality of the information determines whether or not the analysis will be correct. Infor- 
mation is the foundation of the entire process, and if the foundation is insecure the whole build- 
ing will be insecure. It is therefore necessary to use an "information filter,"' deciding what is 
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incomplete, unreliable, subjective, or not applicable. It is a matter of producing actual facts, 
verified and complete facts. Especially, it is necessary to verify that information is up-to- 
date and not too old. In case he does not take extraordinary pains to evaluate the basic figures, 
even the most clever person will work with poor efficiency. This cannot be insisted upon too 
strongly. Many persons are of the wrong belief that extensive statistical techniques can com- 
pensate for low quality of data. It is certainly true that perfect techniques may squeeze the 
last drop of information out of given facts; but they can not compensate for lack of information 
nor eliminate faulty information. Instead, a far-reaching analysis requires an exceedingly high 
quality of primary values. 

The collecting of exact information requires at least as much intelligence, far- 
sightedness, and imagination as it does calculations. Especially, military judgments have 
a tendency to be categorical and tendentious. Partly, this may depend on the military education, 
which requires a "resolute" behaviour and short, clear answers to correspondingly worded 
questions. Facts behind figures are, ordinarily, full of relative proportions, means, compro- 
mises, advantages versus disadvantages, etc. However, in order to emphasize the words, 
military facts are generally presented in a categorical manner. One favours a cause whole- 
heartedly or he is just as whole-heartedly against it. To the scientist seeking after truth this 
is one of the greatest difficulties when working with military matters. The following example 
shows how important it may be to examine available data: In the beginning of the Second World 
War the British Admiralty asked that an anti-aircraft gun should be designed that admitted a 
vertical fire for fighting. Crews on ships attacked by German Stuka dive bombers had reported 
that these planes did attack vertically. Investigations showed that "vertically"' was, as a matter 
of fact, 45° - 75° from the horizontal plane, which makes a great difference to the designer of 
weapons, Thanks to these investigations, far-reaching constructional work and manufacture of 


new complicated material was avoided. If the information base is increased enough, the decision 





very often comes automatically. 





DEFINITION OF THE PROBLEM 

It is necessary to have a "Frenchman's attitude" to clearness and exactness. It is not 
sufficient just "to feel what you mean."" The problem has to be defined and worded clearly, 
which sounds very easy but is in reality very difficult. Sometimes, the problem is solved in the 
same moment as it gets its exact wording. One must ask himself: ''To what doI really want 
an answer?" Aclassic example of such a question concerned the Atlantic convoys during the 
Second World War. What was the primary purpose? To sink more German submarines or to 
get more ships safely across the Atlantic Ocean? An investigation of the efficiency of the anti- 
aircraft guns on British merchant vessels in the Mediterranean proved that the number of 
German airplanes shot down was very small, for which reason the efficiency of the guns might 
be questioned. The essential thing was, however, not the number of airplanes shot down but the 
number of sunken ships. For ships without anti-aircraft defense, the casualty figure was 25 
percent; for vessels armed with anti-aircraft guns, only 10 percent. 

In another example, an operations analyst in England was asked to try to improve the 
efficiency of the maintenance work on airplanes. He happened to be a biologist and thought of 
the problem in terms of the lifetime of a certain airplane. After a certain number of flying 
hours an airplane is overhauled and is then ready for flight again. The number of airplanes 
"ready for flight’ was kept as high as possible. The objective was 75 percent (but 65 percent 
was more common). Flying crews presented no problem. The total number of airplanes 
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however, was limited. The biologist, proved that the criterion "airplanes ready for flight'' was 
not the principal matter. The thing desired was "flying airplanes." (By preventing all flying 
one could soon obtain 100 percent of "airplanes ready for flight!) Therefore, they went to the 
opposite extreme. Every airplane that was "ready for flight" was actually flown. The percent 
of “airplanes ready for flight'' decreased, but more airplanes were flown. The analysis resulted 
in doubling the striking force without a further increase in airplanes and ground personnel. 

An example of a wrongly stated technical demand which can be mentioned is a require- 
ment for a light anti-aircraft gun to protect a bridge, with the gun on the bridge. What one 
really wants is protection for the bridge, and it may be better protected with a heavier gun 
placed some miles away from the bridge. 
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| PERSONNEL AND ORGANIZATION 

; To solve the above problems it is necessary to use personnel of very high quality with 
analytical ability and varied experience. At least three categories ought to be represented, 
namely, scientists, engineers and "users."" These people ought to have a high general intel- 

. ligence, a critical ability for observation, a good knowledge of scientific methods, the power 
to see problems from a broad point of view, an urge to experiment, and, last but not least, the 
ability to present results in an accessible way. Someone has said that an ideal operations 
research group should have Charles Darwin for the field work, Karl Pearson for the statistical 
work, and Bertrand Russell for the logical test of conclusions and the intellectual stimulus to 
the other members of the team. 

System analysis is more a matter of attitude than a method that can be learned in a 
textbook. Without this attitude, even the most scientific statistical analysis may lead in the 
wrong direction. System analysis, like other operational research methods, is a staff function 
that ought to be placed near the top of an organization. There must not exist any restrictions 
on access to information due to security reasons, for example. The team should have freedom 
to do its work without pressure. Scientists cannot work effectively at the same speed that offi- 
cers and engineers generally do. 





BDH RES 


THE IMPORTANCE OF SEEING THE WORK FROM A BROAD POINT OF VIEW 

It is very important to see the problem as a whole when different elements are inter- 
connected. The intention is to balance all the components so that the total efficiency will be as 
3 high as possible. A weapon is only a component in a larger military system. The problem of 
; whether or not the World War II British bombers should have been equipped with defrosting gear 
when bombing Germany is an example. When the advantage of defrosting was weighed against 
diminished bomb load, it was found that the loss in lives and airplanes would be less without 
defrosting. Fewer flights would be needed to destroy a target, so flying personnel would be 
exposed to fewer risks. 





QUANTITATIVE ANALYSIS 

: An analysis must not only be qualitative, but also quantitative. It shall not only produce 

Z adjectives! The famous English scientist, Lord Kelvin, once said: ''When you can measure 

: what you are speaking about and express it in numbers, you know something about it, but when 
you cannot measure it, when you cannot express it in numbers your knowledge is of a meagre 
and unsatisfactory kind."' If system analysis is to be a scientific tool, one is obliged to have 
measurable and comparable values. For one needs numerical values in order to treat a 
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problem with statistical and mathematical methods. The most important elements must be 












sorted out and the immaterial ones thrown away. If there are too many basic elements the te 
problem will be very difficult to analyze. It is therefore necessary to separate the primary ined 
and secondary factors. There is a common tendency for military authorities to construct a 
weapon that can do many different things. One must be sure that the weapon is not designed so 3 aaa 
that it has its maximum efficiency in an area of variables where the possibilities of success 2 os 
are small. What may happen if one specialist gets the upper hand is shown in the figure below. 4 ints 
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As an example of a classification of demands on the construction of a field gun, the fol- % 
lowing can be mentioned: anal 
Class I Class Class II sim] 
1. Effect on the target 1. Rate of fire 1. Life span mote 
2. Active range 2. Weight 2. Necessary production capacity Soci 
3. Probability of hitting 3. Muzzle flame and smoke (material and working hours) rang 
4. Fitness for field service > and 
A complete judgment is formed partly on fairly reliable technical data about the actual : desi 
weapon and partly on other factors that are more difficult to obtain and which, in many cases, 5 a pl. 
necessitate an essential simplification of the analysis. Therefore, it is often necessary for the 
estimation of different weapons in battle to define a limited number of "normal" battle situa- THE 


tions. For every battle situation it is, as a rule, also necessary to assume far-reaching 
restrictions and definitions of the capabilities of one's own side as well as those of the opponent. 
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In this way one tries to define a technical battle situation so that it can be described mathe- 
matically. The difficulties of defining battle in a mathematical way can, to a certain extent, 
be compensated for by investigating different alternatives for the battle. In this connection, 
game theory may give valuable results. A battle between bombers and air defense can be 
described as a game where the attacking forces and the defending forces have different moves 
to make and each side tries to choose its moves so that it obtains optimal payoff even if the 
opponent is making an optimal move. 

In "Naval Research Logistics Quarterly" for June 1954 is described a method for 
choosing from a class of weapon systems of a fixed cost that system which maximizes the 
expectation of military utility. The estimation of different factors is facilitated by the occur- 
rence of operative constants. Thus, the number of mines per lost ship has been shown to be 
the same for German mines in the English Channel as for British mines in German waters and 
for American mines in Japanese waters. The reason for the occurrence of these constants is 
the human factor's dependence on the technical. Machines enforce certain rules that limit the 
individual variations and equalize the effects of such factors as fatigue, weather, etc. 





THE CREATION OF A MATHEMATICAL MODEL 

A mathematical model is created when the different alternatives for solving a problem 
have been examined. The technical world we live in is very complicated, but for practical 
reasons the working models must be relatively simple. 

Mathematical models that describe a battle between two forces have been formulated by 
one of the pioneers in operations research, F. W. Lanchester, in Aircraft Warfare (London 
1916). The most important of his laws states that the effective force is proportional to the 
effectiveness of the weapons multiplied by the square of the number of units engaged in the 
battle. The landing operation on Iwo Jima has been analyzed with Lanchester's theories and 
has given striking results in comparison with the actual events (JORSA 2:163, 1954). Lanches- 
ter's theories are particularly useful when a great number of participants are involved. But 
when only a few units are involved, as in sea or air battles, Markoff models have proven to be 
more suitable. In such a model it is possible to take into consideration many different factors. 
A battle at sea or a duel between two tanks or airplanes can be divided into different stages by 
deciding the transition probability between the various stages. 





USING ELECTRONIC COMPUTING MACHINES OR CURVES 

To solve the great number of optimality problems that usually are obtained in system 
analysis, electronic computing machines may be required. Sometimes, however, the use of 
simple curves proves effective. In Figure 2 is shown an example of a simple analysis of a two- 
motor civilian transport airplane (after a lecture of A. E. Raymond to the Royal Aeronautical 
Society on 10 September 1951). The demands are: maximum-speed at lowest height, 800 km/h; 
range, 2400 km; top height with one motor, 3800 m; take-off distance to 15-m height, 2000 m; 
and landing distance from 15-m height, 1350 m. An airplane inside the shaded area fulfills the 
desired conditions. If the requirements are set too high there will be no shaded area, and such 
a plane is impossible to construct. 


THE PRESENTATION OF THE SOLUTION TO DECIDING AUTHORITIES 
When the problem is solved it must be translated into intelligible language. All solutions 
must be put forward, even those that look absurd at a first glance. A solution should not be 
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AN AIRPLANE WITHIN THIS SURFACE 
FULFILS THE DESIRED CONDITIONS 


AIRPLANE WEIGHT (kg) 
ode Maeda Bhat Be 


8 5 8 


MAXIMUM SPEED AT GROUND LEVEL = 800 km/h 


18000 l 1 | 
20 40 60 80 100 


WING SURFACE (M2) 








Figure 2 - Simple analysis of a two-motor civilian 
transport airplane 


rejected only because it has been tried and previously found inappropriate. The circumstances 
may have changed. 

The analysis should only give facts about the best way to reach a desired goal. The 
analysts have no responsibility for the decisions. How the results of the analysis shall be 
evaluated and judged is the problem of the deciding authority. Elementary mathematics is 
often sufficient to understand a problem, although higher mathematics may be required to solve 
it. Was it not Mark Twain who remarked that you don't have to be able to lay an egg in order 
to recognize it as rotten? The deciding authority, however, should have a certain amount of 
education in statistics and be familiar with the methods of scientific thinking. He must have a 
desire for objectivity. He must not be inclined to use only those results that fit into previously 
accepted theories and opinions and, with utter contempt for facts, throw away inconvenient 
results into the writing table drawer or into the waste basket! 


COMMON SENSE 

One can ask oneself if it is not easier to reach a better solution far quicker with common 
sense than with system analysis. What is meant by common sense? Think of two individuals 
with diametrically different opinions about the same thing. Each will surely call his opinion 
a result of common sense. Common sense is not always to be trusted. Common sense tells us 
that the earth is flat as a pancake. It also tells us that a bit of steel is solid. An X-ray photo 
shows, however, that it consists mainly of empty space. 
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He who does not entirely trust his judgment shows, thereby, good judgment! Even the 
soundest judgment must always be distrusted, for it is impossible for one person to collect all 
the elements needed to make it infallible. Error sources always sneak into all decisions; first, 
because they are never as reasonable as one tends to believe and always contain a certain 
amount of emotional thinking and, second, because they are founded on incomplete information. 
Pessimists consider common sense as rare as geniuses. A great number of opinions are 
fostered by defective statistical education which makes us pay too much attention to trifles. 
Mathematical and statistical methods, on the other hand, admit that data can "speak for them- 
selves" without being affected by human errors. The power of mathematics lies in the fact that 
one is forced to stick to facts through which the number of wishful dreams is reduced. The 
advantage of an unprejudiced mathematical analysis is that it will also be impartial. Mathe- 
matics does not choose sides! It replaces judgment with figures. This does not mean that one 
shall not use common sense and good judgment. One must strive for a combination of mathe- 
matical analysis and common sense that can be called scientific or quantitative common sense. 
Common sense can be channeled so that it works with better effect. 

One of the greatest advantages of system analysis is that one is forced into active 
thinking and must go to the bottom of the problems. It is quite common for human beings to 
try to find tricks to save themselves from thinking through their problems coherently and aim- 
fully. To say that men are thinking beings is a poetical exaggeration. Human beings are "actu- 
ally"' very lazy and try, quite naturally, the most simple remedy which, however, is not always 
the best one. Thinking is troublesome and consumes much more energy than is generally 
believed. Despite the fact that the brain only represents 2 percent of the body weight, it con- 
sumes normally about 25 percent of the total energy! Generally, it is individuals with an 
instinctive unwillingness for active thinking and a dislike for thoroughness who "react" against 
every systematization of work. 

Unfortunately, there are very few human beings who have what Socrates calls daimonion— 
the interior divine voice that warns when knowledge is insufficient for decision. Many executives 
make their decisions on the basis of old judgments and do not question whether or not these more 
or less traditional solutions really are the more effective. Human beings who prefer routine 
thinking and personal prejudices are not at all rare. Apparently self-evident things often need 
to be examined, and this is one of the definitions of a scientist: one who studies things that others 
regard as self-evident. A trained scientist is always hunting for error sources and tries to pro- 
ceed only on clear rules and formulas. Through thinking in terms of numbers instead of words, 
subjective "factors" are avoided. An analysis of accessible data according to mathematical 
methods very often gives viewpoints and experiences that otherwise would have been overlooked. 
An undeveloped mind easily makes quick decisions and has very definite opinions. A scientist, on 
the other hand, is skeptical, expresses himself very carefully, and talks only about relative cir- 
cumstances. Also, it is generally true that the less information one has the easier it is to make 
a decision. A deaf man has less trouble choosing a wife than a man with normal hearing, owing 
to the fact that the former has fewer aspects to take into consideration. But facility in making a 
decision is not the same thing as making the best decision! Knowledge is power, but it requires 
effort to get to the facts and not make only loose assumptions. Pascal says in his "Reflections" 
about mathematical analysis: "One never ought to give approval to other than proven truths, but 
most people are always disposed to believe not the things that rely on evidence but the things that 
attract them." 
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Even if a scientific analysis can't give exact answers and results, it does lead to an 
improvement in the procedure of thinking. One is obliged to examine all facts. The planning 
of the different steps in the analysis compels systematization. It is necessary to think in 
terms of components through which one is obliged to consider which information is required 
and what the next step will have to be. Since most people are bound to traditional trains of 
thought, it is useful to look at one's own problems anew through the application of experience 
from many sciences. Outside the scientific world there frequently is a powerful resistance to 
solving a problem in an objective and unprejudiced way. Many people will not accept a method 
that can seduce them into drawing conclusions which clash with favorite prejudices and intel- 
lectual hobby-horses. 

Human sluggishness and spiritual friction are extraordinarily great. It is not the tech- 
nical difficulties that offer the hardest resistance to the introduction of new methods, but the 
human beings that are governed by traditional ways of thinking. This is especially true for 
individuals that consider themselves "experts" in their fields. It is extraordinarily easy to be 
satisfied and say that so or so is absolutely the best method and that anything else is just non- 
sense. Many executives claim that they have no time to go to the bottom of a problem because 
they are overloaded with red tape and routine work. In the longrun, however, they just get 
more to do if they decide in favor of a poorly analyzed construction, for this will require alter- 
nations, increased maintenance, and so on, and, above all, involve a lessened confidence in the 
responsible executive. 


SUMMARY 

An executive must today, more than ever, make conscious efforts to analyze available 
data. Because more complicated factors have to be taken into consideration and frequently 
5 to 10 years elapse between the conception and production of a complicated weapon, an execu- 
tive can't personally take time to grasp all details. He needs help in arranging the material to 
facilitate the making of decisions. And optimal effect of a series of decisions and actions is 
obtained in the safest way through a systematic analysis of the whole problem as well as its 
component parts. It is a wise man who has his afterthoughts first. 

In Sweden, system analysis has been used by The Swedish Aeroplane Company (SAAB) 


to project new planes, and the favorable results obtained have caused a great interest in its 
continued use. 
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SYSTEMS FOR LARGE EQUIPMENTS 
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1. INTRODUCTION 

1.1 This paper is the result of preliminary investigation into the problem of sched- 
uling aircraft purchases. During the early phases of the study it became clear that certain 
elementary questions which relate to this kind of scheduling could be handled rather easily by 
using techniques based upon a part of probability theory. Our only explicit intent here is to 
describe and exemplify certain methods which are useful in getting answers to questions like 
those cited in paragraph 1.3. 

Because of the extreme generality of the problem underlying the topics actually treated 
(it is essentially the same one which might be expressed in such apparently diverse questions 
as ''How many five year olds will have graduated from college by 1981?"; "Given a certain 
stake, how does the probability of breaking the house compare with that of going broke?"; or 
"Under a certain replacement policy how many electron tubes will be operative six weeks hence 
aboard some given ship?"'), and by reason of the wide applicability of the tools used, it was 
decided to include certain observations, notably those of sections 4 and 9, which, largely for 
quantitative reasons, are not especially germane to the principal context. 

The examples given below are necessarily limited in number and in the variety of their 
treatment. It is expected, however, that the discussion is sufficiently detailed as to indicate 
many of the generalizations and applications which might be made. 

The matrix P_ introduced in the latter part of this paper defines a system sufficiently 
descriptive of actual practice to serve our present purposes. For reference and comparison 
the reader is referred to [3] in which a class of matrices based upon standard overhaul and 
retirement practice for Naval aircraft is defined. These matrices were equipped with entries 
previously derived by the Navy from operational data, and a set of five vectors much like the 
{1 }» {Yi} as defined below, were computed for the Navy for each type of plane for periods 
somewhat in excess of the statutory life spans. 

1.2 Our reference throughout will be to aircraft, although the considerations apply 
equally well to the case of any relatively valuable equipment which is subject during its lifetime 
to a sequence of operating periods followed by overhauls. . 

1.3 A particular kind of ship is purchased and is destined to operate for a certain 
period of time, say N months. At the end of that time, barring washout and emergency removal 
for overhaul in the interim, an overhaul period of n months is begun. At the end of overhaul 
the ship is returned to operations. After a certain number of repetitions of this cycle the plane 
is retired. Given certain initial information such as "so many planes are in the i-th month of 





lWork done under sponsorship of the Office of Naval Research. The authors wish to 
acknowledge their indebtedness to Captain S. R. Brown, Mr. C. E. Ellis, Captain W. E. Gentner, 
and Mr. A. E. Wence of OP-50 for the problem considered and for the stimulating discussions 
at that office which prompted the preparation of this material. 
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the first operational period, so many in the j-th month of the second overhaul, and so many 
new ships of the same kind will be introduced in the k-th month from now" one might inquire 
as to how many ships will be operational six months from now, how many will be in repair, 
how many will be due for retirement in hine months, and so'forth. The methods described 
below show how answers may be obtained for a great variety of questions of this general 
nature, 

1.4 Example I below is intended as an introduction to the notions and techniques which 
may be employed. It is not intended as a description of an actual working situation. It does 
suffice, however, to exhibit most of the ideas employed in the more elaborate model of para- 
graph 6. 

1.5 The Concept of State. The idea of the states of a system is a very general one, 
with a wide range of applicability. For instance, a pair of dice is tossed, and we say that the 
system (the pair of dice) is in state n if the spots showing sum to n. We would then have a 
system with eleven states So, S3,. ? Sy: In what follows we shall be interested in the proba- 
bility of a passage from one state to another, given that the system is in the former. In the 
language of the example, a gambler might want to know the probability of getting a 7 on the 
next roll, given that he has just tossed a 10. Here the system is in state 10 "at time 1," and he 
wants to know the probability that it will be in Sy ‘at time 2," i.e., that he will next throw a 7. 

Another place where the concept of state could be applied is given by the following 
example: The system is now a globe of heated gas. The "state" of the system is defined by 
counting the number of gas molecules in the upper hemisphere. We could just as well consider 
a system of states defined by listing the velocity and location of each molecule in the chamber. 
In general, the reasons for considering the system will dictate to a large extent just what kind 
of states are to be defined. 








In the case at hand our states will be the more or less natural ones which might be used 
to describe the life of an aircraft, such as "the first month following delivery,"' "the second 
month of the first scheduled overhaul," and so forth. 

1.6 Stationary Transition Probabilities. In paragraph 1.5 was mentioned the probability 
of getting a 7 following a throw of the dice which resulted in a 10. In the considerations which 
follow it will be necessary to refer to successive events of this kind by using expressions like 
"at time 0," "at time n"' etc. In doing so we should like our statements to possess a certain 
kind of invariance with respect to time. More precisely, we shall stipulate that if the proba- 
bility of the transition S 107 Sx, given that the system is in Sio at time 0 is Pio, iD then the 
probability of the transition 8197S given that the system is in Si0 at time 11 (11 rolls later), 
is still P10,7° In other words, the dice are not being changed, and all the participants in the 
game toss them in the same way. If we let 2 stand for system we can write the above require- 
ment as follows: 











(1.6.1) PrO(S, 5>Sq |= is in S19) = Prilis, 5S, |= is in S5) =P 


10,7 ° 


The above probabilities all refer, of course, to "one step" (on the very next roll) transitions. 
It will be seen below that when (1.6.1) holds for the one-step case the same will be true for 
transitions over several time intervals. 

A passage from peace to a state of war could cause an increase in the probability of 
passage from an operating state to washout. Simple changes in the technique in use here can 
be employed to handle our problem forithe transition period. 
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1.7 The Markov Property. Several references have been made above to the state 
occupied by the system, mainly in the definitions of the conditional probabilities. It is quite 
conceivable that more of the historical data has a bearing upon the value of the transition 
probability. (For instance, it may become evident that information going beyond the state 
currently occupied by an aircraft has a real influence upon its behavior. Certain of these 
latter difficulties will be obviated automatically through the design of our models. Treatment 
of the more general case is quite within the scheme of things and involves only quantitative 
changes in method.) That is, we might be forced to consider questions of the form "given that 
> was in S5> S¢, Sy at times 0, 1, 2, respectively, what is the probability that it will be in Sy 
at time 3?"" Such questions can be converted into ones involving only the state occupied at 
present by the system. However, these considerations will not be important below. In all the 
cases considered we shall have, 





































(1.7.1) Pr (S7>Sg |2 in S5, Sg, S7 at times 0, 1, 2) = Pr (S;>Sy |> in S, at time 2). 





Systems for which (1.7.1) holds in suitable form are termed Markov. 


2. EXAMPLE I 

2.1 An aircraft is scheduled to operate for six months following its purchase. At the 
end of that time it will receive an overhaul which lasts three months, following which it will re- 
enter the system as a "new" ship. If it should washout at some time (it must washout from an 
operating state) it is reborn as a new plane after two months—that is, a new craft will take its 
place at that time. If it should require an unscheduled overhaul, this will be performed in the 
same manner as a scheduled one and will require the same amount of time. We shall describe 
this system by means of nine states Si, pecs Sg, defined as follows: 





a S;: The ship is in overhaul but has not completed the first 30 days there. 

a So: The ship has completed 30 but not 60 days of overhaul, or the ship has washed 
ie out but has not completed the 30th day of its reentry period. 

4 S3: The ship has completed 60 days overhaul but has not reentered the system as 


an operating craft, or the ship has completed the 30th day of the reentry period 

for washouts but has not reentered the system as an operating craft. 

4 The ship has entered the system new or has reentered from S3 but has not 
completed the 30th day of operations. 

Ss, S6> The ship has completed 30, 60, 90, 120 but not 60, 90, 120, 150 days operations, 

Sy, S3: respectively. 

Sg: The ship has completed 150 days a eieanaaa but has not entered its scheduled 

overhaul and has not washed out. 

2.2 It is implicit in the above that the events of entry into the system, washout, and 
emergency overhaul can occur only on the 30th, 60th, etc. day counted from the starting point. 
Actually, this is little in the way of a practical limitation, since we could just as well have con- 
sidered the system day by day and enlarged our system of states about thirtyfold. Also, it is 
unnecessary for us to carry along the expressions, 30th day, 60th day, and so on. We can just 
as well use the phrases time 1, time 2, etc., in all future references of this kind. Figure 1 isa 
schematic representation of the possible paths open to a ship in the system just described. 

2.3 From Figure 1 it would appear that certain of the system events are sure. A ship 
in state 1 must pass to S» and from So to S3. In some of the states, for instance state 6, the 
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Figure 1 


ship has a threefold course of action open to it. It may washout (pass to So), or require unusual 
overhaul (pass to 81), or simply survive and proceed to the next operating state (pass to S,). 

To complete our model we shall assign probabilities to the events of washing out and of 
requiring nonregular overhaul. Let these be q and p, respectively. Using Figure 1 and the 
numbers p, q, it is now possible to describe our example completely by means of a matrix P. 
Some of the advantages in doing this will appear below. 








oonwnonwrtowown 


The indices on top and to the left of P refer to the various states, 3 to S3, and soon. The 
(i, j) entry of P is the conditional probability that: given that a ship is in state i at time n it 
will be in state j at time n+1. Evidently, since by definition an aircraft in any given state 

must pass to another of the system, the entries in each row must sum to 1. In particular, r, 
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the probability of survival from one operating state to the next, must equal 1-p-q. Entries 
missing in P are zero. One may check P against A, noting that a particular entry (i, j) is 
non-zero if, and only if, an arrow leads from i to j in Figure 1. 

2.4 In the above the probability of a passage from S4 to S5 has been set equal to that 
for a passage from S5 to Sg: If we should want to consider a model wherein the chances of 
washout and unusual overhaul increase (or decrease) as the end of an operational tour is 
neared, corresponding changes could be made in P. The diagonal of r's would be changed to 
Ty> To» etc., and suitable adjustments made in the p's, q's. 

2.5 The model just described evidently possesses the features of no permanent retire- 
ment for aircraft and of automatic replenishment with a fixed lead time for replacement of 
washouts. Before passing to systems more descriptive of reality we shall discuss certain 
properties of the probabilities Pij and of matrices like P. 


3. POWERS OF P AND HIGHER TRANSITION PROBABILITIES 

3.1 The matrix P describes a Markov chain.2 Certain properties of such matrices 
will be useful below, and they will now be described. 

3.2 Suppose we denote the (i, j) entry of P by Pij so that Py = 0, Py9 = i, P4, =P; etc. 
Then, as already noted, P; j is the conditional probability that: the system will be in state j at 
time n+l, given that it is in state i at time n. One could inquire concerning the probability of 
a passage from i to k in two time periods. Suppose ~, the system, is in S; at time n. Then, 
in order to be in S. at time n+2, > must occupy an intermediate state S. at time n+l, where j 
can be any of the indices 1, 2, 3,..., 9. Using the usual formulae for manipulating conditional 
probabilities and the Markov property noted in paragraph 1.7, the probability of the passage 
S°S>>8,, is found to be equal to Pij Pik: Since j can be any of nine indices, the probability of 
the two-step transition SS, is obtained by summing the expressions Pi;° Pik over j. We have 
then, 











j 


© 


(3.2.1) pa = Pi Ph: 
The superscript 2 on pa. stands for the time lapse and pa is the conditional probability that: 
Z will be in S. at time n+2, given that it was in S; at time n. 

3.3 The above expression for pa will be recognized as that for the (i,k) entry of the 
matrix product of P with itself. In other words, the two-step transition probabilities for the 
system 2 are just the entries of P x P computed by the rule (3.2.1). Thus p2, would be equal 
to p- O+q - 0+0- 0+0- ptr: p+O0- p+0- p+0- p+0- (1-q) = rp. This corresponds to the situation 
depicted in Figure 1, wherein the only way to get from S, to Ss; in two steps is by going to Ss 
(probability r) and from there to S; (probability p). In this connection it should be noted that 
a passage like SPS-s, is a perfectly valid method for getting from 8; to Si in two steps. 

It cannot actually happen in the case at hand, since all our diagonal elements Pi, are zero. 

3.4 It can be shown rather easily that the transition probabilities for an arbitrary 
number of steps are obtainable in the same way as the pa . In general Pik (the conditional 
probability that 2 will be in Ss. at time n, given that 2 was in S; at time 0) is given by the 
formula (3.4.1). 





2A beautiful and readable account of certain kinds of Markov chains is given in [1]. 
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(the (j, k)) element from PY’, (P*), pt (r any positive integer) stands for the matrix product, 


where r +S =n, r,s 20, p 0 unless i =j and Pi = 1, and where Pi (Pi) is the (i, j) | 


r terms 
“‘PxPx...xP 





3.5 It can be readily demonstrated that the row sums of p" n>1, are again unity. For 
the case n=2 we have 


9 . 9/3 ) 
z : 3 tu«d 
k=1 Pik “x21 \jz1 Pid’ Pik 

(3.5.1) Din 8 

3.5.1 =f vu D; 

j-1 Ux-1 ik 
3 
“ma 


The cases n>2 can be handled in the same way, using the inductive hypothesis: 
9 
z= Pik = 1, r<n; and the formulae (3.4.1). 


k =1 


3.6 It is of some minor interest to note the rather simple form which the S have 


when expressed in terms of the pk 


ij’ k<n. We have directly from P that 


n+1_ n n n 
(3.6.1) Pij = 4 P* Pyjt Poi + Pitt, j,if4 <1 <8 
n n te 8 
(1-4) P45 *4- Po; ,ifi=9 


4. SOME FURTHER REMARKS CONCERNING P 

4.1 There is an additional feature of P having an intrinsic significance somewhat 
removed from any contextual interest. Its statement in paragraph 4.2 does, however, call 
attention to the rather important question of system behavior over long periods of time. It 
serves also to exhibit the correspondence between the mathematics of the model and what might 
reasonably be inferred or deduced experimentally about this kind of system when it is allowed 
to operate for several time periods. 

The passage of = to what might be called its steady state is illustrated in Table 1 and in 
the bar charts of paragraph 4.6. 
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4.2 In the case of the matrix P a certain theorem? states that lim Pi exists for each 


n> co 
(i, j) and that these limits are row independent quantities ui satisfying the system of linear 
equations (4.2.1). 
9 9 
(4.2.1) u.= 2 p = ut. 


sel; 5 
, (ah 9 et 
This system may be solved for Ug, Ug,--- Ug in terms of uy. Finally, the requirement 


9 
z u; =1 is used to determine Uy: The solutions are as follows: 














j=l 
1a - +) 
l-r 
u = 
1 
3, - a) -r) 
1l-r 
1 
u = 
2 
’ l-r 
Ug = Ug = Us 
o42r 1 <5 
Uiig = Ug» <j< 


4.3 The kind of system described in Example I can be enlarged easily to one in which 
the length of the operational tour is 4 + 1, overhauls require k time periods, and washouts are 
replaced in m<k time periods. The solutions corresponding to (4.2.2) for the more general 
case are given by (4.3.1). 


uy = A/[(k - m) A +m +(l+r+...+ 74] 
us =U,,2<ick-m 
(4.3.1) 
u; =u,/A,k-m+l<cick+1 
Usd si =r'u,/A,1 ce 


where A = p(ltr+r?i. ont r*-1) + r*(1 -q). 


4.4 The two preceding paragraphs mean simply this: That a system operated like that 
of Example I can be expected, following a certain initial time lapse, to have, from then on, 
u, - N aircraft in S)> Us ° N in state 2, and so on, where N stands for some initial number of 





3See again [1], in particular, Chapter 15. 
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planes inserted into any state of the system and where replenishment of washed out ships is 
accomplished in the manner called for by the structure of P, or, in the case of paragraph 4.3, 
automatically after m time periods. 

4.5 The powers P" were computed for n < 1022, using r = .97, P = .02, q =.01. 
Table 1 lists certain of the results, to four decimal places. The computed pj 22 differed 
from the Ui, obtained by using (4.2.2), by about 1078. 





















































TABLE 1 
a |} PY, | Pio | Pas | Pia! Pis| Pis| Piz | Pis | Pio 
oO; 1 0 0 0 0 0 0 0 0 
5 | .0194 | .0297 | .0100 | .0000| .0000| .9409/ .0000| .0000| .0000 
10 | .0019 | .8524 | .0278 | .0277| .0272| .0271| .0271 | .0089 | .0000 
15 | .0410 | .0514 | .0537 | .0210| .0037 | .0029| .7780/ .0246 | .0238 
20 | .0075 | .0082 | .7290 | .0489| .0473 | .0466| .0469 | .0475| .0180 
25 | .0566 | .0660/| .0691 | .0728| .0312| .0094| .0075| .6454 | .0420 
50 | .0936 | .1087 | .0626 | .0349| .0290| .4407| .0791 | .0760| .0754 
100 | .0662 | .2317 | .1111 | .1090/ .1074| .1108| .1166 | .0845/| .0628 
250 | .1102 | .1164 | .1177 | .1204| .1141/} .1079/| .1031 | .1091/} .1010 
500 | .1109 | .1175) .1175|.1175) .1139 | .1106| .1072 | .1040| .1009 
1000 | .1109 | .1175)| .1175|.1175} .1140} .1105| .1072 | .1040/| .1009 
sit nul 4.6 In the charts of Figure 2 the bar 
heights are proportional to those entries in 
Table 1, with the same time index t. They 
depict the distribution of airfraft in 2 fol- 
lowing the insertion of a block of N planes 
t=10 t=15 into S at t-0. The height of the jth bar in 
the diagram for t=k is the expected fraction 
of the N aircraft in S, at time k. A descrip- 
tion of some of the rationale behind the use of 
: t=20 t=25 the term "expected" follows in Section 5. 
5. FURTHER REMARKS CONCERNING 
t= 50 t=100 (2, P) 
5.1 It will be convenient in this sec- 
tion to continue to refer to the system (2, P) 
oNaswaswasen of Example I, although the considerations 
carry over almost word for word to any of 
the systems being studied, and in particular 
t= 250 § S00 to the case of Example II. 

5.2 Suppose that one tossed a fair 
coin one hundred times. There is some 
intuitive feeling that 50 qualifies for the title 

of "expected number of heads." This termi- 
nology is traditional in a more formal sense. 
Figure 2 In the case of repeated trials of the same 
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kind where each result is one of two possible ones, say A and B, the expected number of A's 
is defined to be the quantity E(A) where, 


(5.2.1) E(A) =N- p(A), 


and where p(A) stands for the probability that a single trial will result in A and N for the 
number of trials. For a "fair" coin we have p(H) - ; and the figure 50 results from the 
computation (5.2.1) with N = 100. 

5.3 In the case of the matrix P we have, by definition, that the probability that a ship 
in 8; at time t=0 will be in S, at time n is Pi. .Picking one particular state, say Si; we 
perform the "trial" of watching the ship until time n. Then either it is in S, or not in Si, 
i.e., in So, S3, patel Sg: The probability of the former event is Pip while that of the latter is 


1 - Pip or, by (3.5.1), Pi9 + Pi3 ee Pig: Starting with N aircraft in S; at time 0, we can 
regard their careers until time n as repeated and independent (they presumably do not crash 
into one another too often) trials of the same kind. This is precisely the situation described 
in paragraph 5.2, and we call Ni =N.- Psy the expected number of planes in Ss; at time n. 

The same considerations apply to any separation of the states S. into two disjoint 
classes. For instance, if we start with N planes in S) at time 0 and wish to compute the 
expected number in operation at time n, we have for the case of (2, P) that: 

The probability that a plane in Ss; at time 0 is operating at time n is 

Pia + Pis + Pig + Pi7 + Pig + Pig , Since S4, Ss» melee So are the totality of 

operational states. 

Similarly, 

The probability that a plane in S; at time 0 is not operating (is in overhaul) 

at time n is PH + Pio + Pi3> since Si, So, S3 are the only non-operational 

states for 2. 

To take an example: Let N = 1000; then from Table 1 we have that: 

The expected number of planes in S; at time 5 is 19 

The expected number of planes in S3 at time 10 is 28 

The expected number of planes in S, at time 15 is 21 

The expected number of planes in S> at time 25 is 9; 
in operations at time 20 is 48.9 + 47.3 + 46.6+ 46.9 + 47.5 +18 = 255; in overhaul at time 50 
is 93.6 + 108.7 + 62.6 = 265. 

5.4 The last two kinds of probabilities mentioned above are of particular importance 
in that they are basically related to aircraft build-up and abandonment-of-type programs as 
well as to questions concerning repair overload. We propose, therefore, to consider them in 
more detail and to illustrate their usefulness in connection with questions of aircraft program- 
ming. 

5.5 It will be convenient to adopt certain simpler notation for the partial row sums used 
above. We shall also agree that all aircraft coming into the system are inserted into S 4 the 
first operational state. or5 Vis the probability that a plane in S4 at time 0 is operational, in 
overhaul, respectively, is defined as follows: 
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Suppose now that a certain number N of new planes are inserted into S4 of 2 at time 0. 
That part of the future operational strength of © which is due to this input can be read off for 



























Figure 3 
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each time t=0,1,2,3,..., from a graph of the quantities ¢, - N like that of Figure 3. : 
5.6 The stability of operational strength at a point greater than zero evidenced from sy 

about t=13 on is due to the automatic replenishment feature built into the model 2. As we 

shall see below, the long-run behavior of other systems will depend upon the over-all nature 


y. 


of the set of inputs. Roughly speaking, input 
sequences which oscillate rather narrowly 
about some fixed level will produce stable 
operational levels if the operation of this 
system is continued for some time. 

5.7 We consider now the future oper- 
ational strengths of 2 when, starting with an 
empty system, N planes are inserted at t=0, 
and say N/2 at time 1. These figures can be 
read off the resulting graph when the two 
broken curves shown in Figure 4 are added. 
The result of the addition is shown in the un- 
broken curve of that figure. 

5.8 Evidently, from the foregoing, one 
must add certain multiples of the ''fundamental" 
curve shown in Figure 3 in order to obtain a 
given program of operational strength, and 
prior to the addition translate these multiples 
suitably to correspond to the time of the input 
represented. We next show one method where- 
by this may be accomplished for the system 2. 

5.9 We start with an empty system 2 
and imagine that Np planes are inserted at a 
time 0, Ni at time 1, andsoon. Then from 
the definition of the ¢, we have: 

The expected number of operational 
craft at t = OisNp . $9 

The expected number of operational 
craft at t = lisN, "%o +Np . aT 

The expected number of operational 
craft at t = 2isNy "O5+N, o, +No 5 

The expected number of operational 
craft at t = 3isN, %9 + No?) +N, oo + No $3 
etc. 
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In other words, we get the expected number of aircraft in operations at time k by mul- 
tiplying Ni, (those just inserted) by the probability that they will be in operations 0 time hence, 
Nuep the number of those inserted one time period ago, by oy, the probability of passage to an 
operational state in one step, and so forth, and by then adding these quantities. 

Suppose some program is set down by specifying operational strengths desired at times 
0, 1, 2, etc. Let Gp be the number of operational aircraft desired at time 0, G, the number 
required at time 1, etc. One inquires as to the inputs No» Ni, ee »N, needed to produce the 
G:. From the above this would appear to be very similar to the familiar process of adding up 
suitable multiples of cos nx, sin nx to obtain some predetermined curve. The functions graphed 
in Figures 3 and 4 correspond to cos nx, sin nx and the numbers N, to the Fourier coefficients 
of cos, sin. 

From the first paragraph of 5.9 it may be seen that in order to have Gp operating 
planes at time 0 we must have No %o = Go; to have G, at time 1, No o, + N, i) must equal 
G,; and so on. Proceeding in this way we get a triangular system of linear equations which may 
be solved for the N; in terms of the a and G;. Explicitly, the system becomes, 


No $9 = Gy 

N, $9 +No%, = Gy 

No 9 + Ny $1 +No bo = Go 

Ng $9 + Noo) + Ny %2 + No? = Gg 
etc. 


These equations can be solved readily for the Nj. In fact, since oo = 1, we get for solutions 


etc., 
where N, is computed by substituting Gp for No in the second equation, No by substituting 


Go for No and G, - Go?, for N, in the third, etc. 
We now consider an example of this process. Our system is 2, and we set 


Gp = 10 
G, = 20 
Gy = 30 


391368 O - 56 - 3 



































J. FENNELL AND S, OSHIRO 








G. = 40 


G,= 50 
G_ = 60 
Gg = 70 
Gy = 80 
Gg = 90 
G;= 100 , j29. 


The equations (5.9.1) become 


Ny = 10 

N, = 20 - 109, 

No = 30 - ¢, (20 - 106) - 109, 

Ng = 40 - ¢, [30 - $, (20 - 109,) - 1094] - oo (20 - 10¢,) - 104, 

etc. 
Solving these is not as cumbersome as it might appear. Using a desk computer one of the 
authors, in about three hours, obtained Ny for all k up to about 40. Part of the results are 


given below, and the resulting operational strengths are graphed in comparison with the G, in 
Figure 5. The set of required inputs for the above program {G5} was found to be as follows: 

















a <-->: No = 10 Nog = 18 
STRENGTH Ng = 16 Nig= 3 
ware EXPECTED STRENGTHS 
USING INPUTS 5.9.2 (5.9.2) N, =17 Nig = 
| | - _ 
5 — N, = 19 Nj = 0, j216. 
Figure 5 Ng = 19 


It should be noted in this connection that the above N, are not exact solutions to the 
system (5.9.1) because of the need for integer-valued N.; and because we prefer not to admit 
negative inputs, correct solutions such as N, = -.5634 must be replaced by N; = 0. The use of 
negative inputs would change only the computational procedure. No technical difficulties arise. 

5.10 In other words, to build up to and maintain the strength given by the above G, one 
must insert about 183 planes into 2. It should be noted that we cannot consider abandonment 
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programs in connection with 2, since this system possesses no outlets. The figure of 183 

could have been rapidly estimated for this system by computing 100/.5516, where 100 is the 

required "steady-state" strength and .5516 is 2 u., the sum of the steady-state probabilities 
j= 

for the operational states of 2, as defined in (4.3.1). 

5.11 The linearity of {N,} considered as a function of {G,} should be emphasized here. 
If one should desire a program of operational strength equal in each case to twice the G, listed 
in paragraph 5.9, the corresponding N; should be just twice those listed in (5.9.2). More gen- 
erally, if the inputs {Nj} produce an operational program {G_} and the inputs {M.} a program 
{H,}, then the inputs {aN, + bM,, aN, + bMy,...,aN,+ bM,; } = {aN, + bM; } will produce the 
operational strengths { aG, + bH,, aGy + bHy,..., aG, + bH,,.. j= {aG, + bH,}, where a, b 
are any real numbers. 

More compactly, we could write: if N—>G and if M—+H, then aN + bM—»aG + bH, 
where ">" can be read "produces." 

This feature of the programming could be of value in the feasibility testing for size of 
programs of the same "'shape."" The inputs corresponding to changes of size by any given factor 
could be computed readily from a table of inputs prepared for some standard size program of 
the kind in question. 

5.12 We proceed now in Example II to the study of a more practical system =* It is 
more practical in the sense that one can now manipulate its replenishment and because a 
retirement feature is built in. The matrix pt is first given, and its meaning described ina 
general way. Its form can be obtained in precisely the manner used to get P, i.e., by describing 
the states one wishes to use, and by then assigning probabilities to each transition si Sj A 


6. EXAMPLE II 

6.1 The matrix p* describes a system zt in which aircraft move through a schedule 
of three operational periods of length 8 and two overhauls each of length 3, toward retirement 
or washout in state 31. While adequate for the development of our present discussion, pt 
represents a simplification of actual practice in certain respects. For instance, a plane passing 
to unusual overhaul from Ss; is returned to the operational part of the system in the second 


operational period, Si BS + , thus losing some seven months of operational potential. 


Similarly, a plane requiring overhaul in the early stages of its last operational tour is retired. 
These difficulties can be very simply avoided by redesigning pt to represent a more elaborate 
system. 

It should be noted that P* has a "sink," i.e., state 31, into which retired and washed out 
aircraft proceed and from which there is no return (P3131 = 1). Unlike 2, sf is not self- 
replenishing. 
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123 4 5 6 7 8 9 10111213 14 15 1617 18 1920 21 22 23 24 25 26 27 28 29 30 31 

























1 a 
2 . 
3 om 
4 ‘ 
6 4 
7 4 
8 : 
9 
10 3 
11 ‘ 
12 4 
- ; 
14 a 
15 : 
17 3 
18 ; 
19 3 
Re 

21 ve 
2 

z. 

i 

At time 31 all aircraft in =* at time 0 will have been retired. This feature is reflected : 

in the 31st power of p* , which consists of a column of 1's in the 31st column. Thus any con- ’ 
tinued operational strength for =* can be obtained only through the continued insertion of air- j 
craft supplied by industry into some state Sis j < 30. i 









6.2 For reasons of space we shall not reproduce here the powers of p* , Which involve ~ 
about 30,000 lengthy decimals. We shall give in detail, however, lists of all the more important i 
parameters computed from those powers. * 

6.3 We first consider a simple program of aircraft operational strengths G, for the 
system xf . The G; stand for the desired operating strengths at times j, and we list them for 
Program (Ila): 
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Gp = 10 Gs, = 90 
G, = 20 Geo = 80 
Gy = 30 Ges = 70 
Gs = 40 Ge4 = 60 
“ar G, = 50 Gee = 50 
G, = 60 Gs = 40 
Ge, = 70 Gey = 30 
G, = 80 Geg = 20 
Gp = 90 Gs = 10 
G; = 100, 9< j <50 G, =.0, 60< i <70. 


6.4 2 * will be regarded as empty prior to time 0, and the required inputs N, (we have 
decided arbitrarily to insert planes only into S,) will be computed as in (5.9.1), where the $i 
are now defined as follows: 


(6.4.1) $)=1 
8 , 19 30 

(6.4.2) >. = = py; + z= 1 z Py; 1<n< 30 
j=1 “) j=12 *) j=23 * 

(6.4.3) @=0 31<n. 


6.5 It should be noted that if we agree that (P#)° = a diagonal matrix of 1's, and if we 
take into account the fact that Pij , ) < 30, is 0 for all n 2 31 the definitions (6.4.1, 2, 3) can be 
written more compactly in the form, 


8 19 30 
(6.5.1) $0 BE G+ = ee Ee, Oca. 
m lj; 1j j= 23 1j’ 


That is, the >. are, as in the case of ©, simply the probabilities that a plane in Ss; at 
time 0 will be operating at time n, where Si>- nie Sg, Sio weg Sig» and S53) Leto S3o are the 
totality of operating states for = 

The computation of the ¢ - (and that of the other quantities involved) was based upon the 
following values, p = .10, q = .05, r = .85. 

The %, were found to be as follows: 


























(6.5.2) 


(6.6.1) 
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6.6 Solving the equations 


CcaTD AO fk OD °| = 


— 
- © 





— 
i) 


1.0000 


.8500 
.7225 
.6141 
.6220 
.6137 
.5939 
.5662 
.2710 
.2917 
.3073 
.5903 
.5006 
.4290 
.3714 
.3791 


= .3707 
= .3516 
= .3260 


No ¢9= Gp 


No %) + Ny $9 = G 


oowonra & hk OO AD OC OD a re 





. 2226 
.2102 
.1947 
.2510 


= .1915 
= .1450 


.1087 
.0806 
.0590 


= .0424 
= .0297 


.0000 


= .0000 


as in section 5, the required inputs were found to be as follows: 
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With Nj= 0, j> ~ For precisely the reasons cited in paragraph 5.9, it is of interest to 


compare the quantities 2 $,N,_;= G,. with the desired G, as given in (6.3.1), and where the 
j=0 ) K-j 


Ny j are taken from (6.6.1). This ty done graphically in Figure 6. In the same chart the load 
upon the overhaul subsystem for &" also is given. This was obtained by computing, as in 
(5.5.2), the quantities Va which bear the same relation to overhaul states that the $, do to the 
operational portion of af, 


(6.6.2) y = = po. + > P. 


Gr Hy Gy J 
100 


DESIRED OPERATING 
— STRENGTH 63.1 





EXPECTED STRENGTHS 
USING INPUTS 6.6.1 


80 


PLANES IN OVERHAUL 


60 


40 


20 











Figure 6 
The load upon the overhaul system at time k is then given by, 


k 
(6.6.3) H,. = ote ¥; Ny; : 

6.7 The behavior of the G, as shown in G for times k250 illustrates an important 
feature of the kind of system being considered. It will be noticed in Figure 6 that the number 
of operational craft present in st is considerably in excess of that called for by the Program 
Ila as given in (6.3.1). 

The resulting excess is significant in that the system of inputs, (6.6.1), barely maintains 
the required operational strength until time 50. Essentially, the program (6.3.1) is too abrupt 
in its terminal stages. The system has a certain amount of "momentum" which cannot be over- 
come without "negative inputs" such as administrative abandonment or scrapping. 


7. PROGRAM IIb 
7.1 We shall now consider a more complicated kind of program starting with a non- 
empty xt and converting to a different kind of plane during the program. A certain function is 
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being performed by a given kind of plane, and it is desired to keep the operational strength 











available for this function at the levels given in (7.1.1) below. o 
Strength Desired 4 55 
at Time k= G, k 2 
50 0 3 
60 1 % 
70 2 4 
80 3 | 
90 4 4 
100 5 < k <20 : 
105 21 : 
110 22 : 
115 23 ; (7.1 
120 24 ‘ 
125 25 
(7.1.1) 130 26 P $ 
135 27 % 
140 28 4 
145 29 : 
150 30< k< 60 if 
145 61 ul 
140 62 4 
135 63 i ms 
130 64 ie, 
, ' y 
0 90 4 
0 91< k< 200 4 
q 
For computational brevity it was decided to have planes in only two states of xt at 4 
time 0 when we shall suppose that there are 30 aircraft in Ss and 20 in Si and no others a 
anywhere in sf » Save possibly in S31: The treatment of the case where more states contained 4 
planes at the outset can be handled in much the same way and involves only additional compu- a 
tation. 3 (7.1. 
The ships in S5 and Si at time 0 can be expected to contribute to the future opera- E 
tional strength of the system, so we must first compute these contributions and subtract them q 
from the G,. of (7.1.1) in order to obtain the residual program to be supported by inputs into ; 
S;- In order to accomplish this we first set : 
8 19 30 x 
ye P53 * jo 12 P53 * i723 PS} 4 
(7.1.2) 
= 4 n 19 m n E with 


+e £.,4 ; 
1 Pi1,j j=12 Pi1,j j= 23 Pi1,j’ 













; aie ea 
pret tD 


(7.1.3) 
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n K, n K, 
0 30 14 19 
1 46 15 13 
2 39 16 12 
3 33 17 11 
4 15 18 14 
5 18 19 11 
6 19 20 7 
7 35 21 6 
8 31 22 5 
9 23 23 3 
10 21 24 2 
11 21 25 2 
12 25 n> 26 0 
13 22 


G, = G., - K, are listed below. 








n G, 
a ecall 
; 0 | 20 
4 1 | 15 
: 2 | 31 
; 3 | 47 
a 4 | 75 
a @ 5 | 82 
| 6 | 81 
> (7.1.4) 7 | 65 
BS 
4 8 | 69 
| ‘e 9 | 77 
4 10 | 79 
B 
11 | 79 
i 12 | 75 
| 13 | 78 
a 14 | 81 


with G, = 0, 90 <n < 200. 











n G, 
15 87 
16 88 
17 89 
18 86 
19 89 
20 93 
21 99 
22 | 105 
23 | 112 
24 118 
25 | 123 
26 | 130 
27 | 135 
28 | 140 
29 | 145 





n G, 
30<n<60 | 150 
61 | 145 
62 | 140 
63 | 135 
64 | 130 
65 | 125 
66 | 120 
67 | 115 
68: | 110 
69 | 105 
70 | 100 
71 | 95 
72 | 90 
73 | 85 
74 | 80 








75 
76 
77 
78 
79 
80 
81 
82 
83 
84 
85 
86 
87 
88 
89 





and then compute K, = 30 a,t+ 20b, - The quantities an and b, will be recognized as the 
analogs of the +, for states 5 and 11, i.e., they are just the probabilities that a ship in 
S5 (S, 1) at time 0 will be operational . time n, The quantities K, are then the expected con- 
tribution to the operating strength of 2" resulting from the planes in S5 and Si : 

s The quantities K, were computed and were found to be as follows: 


Subtracting K, from G, we obtain the residual program to be supported. The quantities 


Ql 





75 
70 
65 
60 
55 
50 
45 
40 
35 
30 
25 
20 
15 
10 
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k 
Solving the equations + iN, "io G,. as before, the required inputs were found to be 
j=0 : 











as follows: 5 
k | N, k | Ny k | N, k | N, 7 
0 | 20 21 | 13 42 | 12 63 6 7 
1 | 0 22 | 15 43 | 12 64 | 6 ; 
2 | 17 23 | 16 44 | 12 65 5 ; 
3 | 20 24 | 16 45 | 13 66 | 5 j 
4 | 33 25 | 17 46 | 13 67 4 4 
5 | 17 26 | 18 47 | 13 68 | 5 3 
6 | 8 27 | 18 48 | 13 69 | 3 ; 
7] 0 28 | 18 49 | 14 70 3 4 
8 | 4 29 | 21 50 | 14 71 | 2 4 
9 | 11 30 | 20 51 | 14 72 | 4 4 

(7.1.5) 10 | 10 31 | 15 52 | 15 73 | 2 3 

11 | 4 32 | 14 53 | 14 14 | 3 EI 
12 | 11 33 | 13 54 | 14 75 | 3 j 
13 | 7 34 | 12 55 | 15 76 | 3 a 
14 | 4 35 | 12 56 | 14 77 1 : 
15 | 2 36 | 12 57 | 14 78 2 ; 
16 | 5 37 | 12 58 | 14 79 1 a 
17 | 9 38 | 12 59 | 13 80 1 4 
18 | 7 39 | 11 60 | 13 81 1 i 
19 | 10 40 | 10 61 | 8 n>82 | 0 : 
20 | 9 41 | 10 62 | 8 














The comparison between the proposed program {G,} and that achieved under the system 
of inputs (7.1.5) is of particular interest here. The planes in S5 and Si just before time 0 
serve to produce a surplus of operational craft twice in the early stages of the program. This ; 
happened because of the need for a negative Ny, i.e., the correct solution of Ny i) Ss No oy = G, 
was less than zero. In the models being considered such N, are taken to be zero, and a pro- 
gram in excess of {G,} was induced. Also, the slope used during the latter stages of IIb, i.e., 
a drop of 5 planes each month, is shown to adhere much more closely to the natural rate of 3 
decay of operating strength than was the case in Ila where decrements of 10 were used. The 
comparison is shown in Figure 7. : 

7.2 Suppose now that a new aircraft, y, will be made available in certain quantities ia 
during the program IIb and that one desires to abandon the former model, call it x, as rapidly 3 
as possible. Then one proceeds to modify the Ny listed in (7.1.5) by reducing them as much as a 
possible in the light of the availabilities for y.* For instance, suppose model y would be avail- ~ 
able in quantities R, at time k where a 


ES ee FO 














*We are assuming here that the new model has the same p,q, r as x. More about this 
question below. 
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(7.2.1) 


Then if we let Ni» M, 


stand for number of model x to be used and for the maximum number of 
em 4 model y which can be introduced subject to IIb, we get the following schedule of inputs: 


Figure 7 

R, = 0 0<k< 50 
R, =1 Bl < k < 55 
R, = 2 56 < k < 65 
R, =5 66<k. 








is i k Ni. k k N,. k Ni. k N, 
“@ 
ig 0/20} 0 14/4] 0 28/18] o 42/12] 0 56\12| 2 
» - 1/0} 0 15] 2] 0 29]/21| 0 43\/12] oO 57/12] 2 
: 2|17/ 0 16| 5] 0 30/20] 0 44/12] 0 s58\12| 2 
? 3/20| 0 17/9] 0 31/15] 0 45/13] 0 59/11] 2 
4/33} 0 18] 7] 0 32/14] 0 46113] 0 60/11] 2 
5/17} 0 19 0 33/13| 0 47/13] o 61| 6| 2 
(1.2.2) §| 8| 9 20 0 34/12] 0 48/13] 0 62| 6| 2 
7/0] 0 21 0 35/12| 0 49/14| 0 63| 4| 2 
81 4| 0 22 0 36/12/ 0 50/14] 0 64/4] 2 
9/11] 0 23 0 37/12| 0 51/13] 1 65] 3] 2 
10/10} 0 24 0 38/12] 0 52/14] 1 66] O| 5 
11/4] 0 25 0 39/11} 0 53/13| 1 67] O| 4 
12/11} 0 26 0 40/10] 0 54/13] 1 68] o| 5 
is 13/7] 0 27 0 41/10| 0 55/14] 1 69] o|] 3 
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In other words, 


if N, 2 R, then N= N, - R, 
M,= R, 
if Ni, < Ri, then N,= 0 


M, = Ny ‘ 

7.3 It is fairly clear that the above method of replacing x's by y's is meaningless when 
the system parameters for the two kinds of plane differ. By system parameters are meant the 
quantities p, q, r and whatever other probabilities may be basic to a description of the system, 
together with the various numbers describing such things as length and frequency of operational 
periods and overhauls. In order to show how the situation may be handled in the case of two 
kinds of plane x and y with two systems zy and zy determining their behavior, we consider 
the following variant on the preceding example. 

7.4 The plane y will be available in quantities Yj» j > 0, and let ohooh correspond (for 
the two aircraft types) to the numbers a as defined above. One proceeds in a sequence of 
steps o j as follows: 


a y 
Solve No ¢9 = Gp for No 
0 if Nj <0 
Set N} = Nj if 0 < N 
Yo if Nb > Yo» 
and set ¥1=¥, +¥9- NB. 
F WY ay y > y 
95: Solve No? +Ny $9 = G, for Nj 4 
(oO if Ny <0 


Ny if 0 < NY < J, 





[yy if NY > 9, 


and set Vo = ¥2+¥,-NJ. 
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N(x) as follows: 
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Yay i. ny aY er y 
Solve No $5 +N} ¢} +No¢9= Gp for Np 


(oO if Nn} <0 


- y ; Yig 
Set Ny = No if 0 < NO<Y¥p 





[¥q if ND>¥, 
and set V3 =¥3+¥_- Nb. 


» | 
Proceeding in this way we obtain a system of inputs Ni. for aircraft type-y. Next the quantities 


* 


a 
244 


G, = 
k~ 59 


are computed and the "residual" program {G, - G,} determined. Finally the equations 


k 
- _& 
xP Nj OK j= &- & 


are solved in the usual way for the inputs of the x-type plane. 
7.5 The introduction of the quantities Ve in the above serves simply to refurnish at 
time k+l any surplus of y existing just after time k. 


8. REMARKS ON THE Ni 

8.1 The behavior of the inputs N; is worthy of special note in at least one case. Sup- 
pose that a system like z* is empty prior to time 0 and that the program of operating strengths 
to be supported has the form G, = X, 0<j, A a constant. The associated N; can oscillate rapidly, 
aperiodically, and for a considerable period of time. In a trial computation the inputs were 
observed to rebound in an irregular manner from limits roughly on the order of +0.8\ during 
the early stages of the program and to level off only after a period of years. Thus, overly 
rapid build-up programs can be expected to have rather striking effects upon the numbers of 
planes in operational status. 


9. FURTHER THEORETICAL REMARKS 
9.1 Suppose that one has a program {G,} to be met in a system described by a matrix 
P like the matrix P used above. We shall imagine that the program is to be continued indefi- 
nitely and that from some time on, say k+1, the G; are all the same, i.e., Gy, j = A, j= 1,2,3,.... 
One might inquire as to what extent the solution to the system 
k 
st Ny. j %; = G, k = 0, 1, 2, 


(9.1.1) 


may be expected to resemble the G,. Specifically, will the N, be constant or almost constant 
for all sufficiently large j? In order to answer this question we define formally the function 
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to ¢) 
- k 
(9.1.2) N(x) = 7 z, G, x ‘/otx) 





bad k 
o(x)= = $x 
k=0 






In the cases at hand, say of p* or, for that matter, any of those matrices P associated 
with actual aircraft types, (x) is a polynomial. ($70 for indefinitely large k would simply 
mean that no retirement provision has been made for the aircraft in question.) Using the 
above definition of the G, we can therefore rewrite (9.1.2) as, 















From (9.1.3) N admits expansion in a power series about the origin converging in the 


disk o<r<a where ae? is the root of ¢(x) which is nearest the origin. Moreover, the multi- 
plication 









must be valid when| x | <a. 
Accordingly, 


j 
(9.1.4) =D Ni, ¢,=G,. 
1=0 


— 

' 

— 

— 

— 
aS NE OLE aa AER 


Since the solution to (9.1.4) is unique, the coefficients N, of the power series for N(x) 
must coincide with the inputs required to support the program {G;}. 
From (9.1.3) we have 


















= Gz 
) i_ i=o i rxxhtl 
z= N,x = + 
i=o (x) (1-x) (x) 














or 





(1-x) > N,x = 2 (N; - N,_1)* 


i=o 
= (G, - G, ,) i p(x) 
= 2 47 G.y)* x 


where N_,= G_,=0. By definition of a we have 
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1 
7 i 
lim sup|N; - N_4| 
i>o 


2. 
a 


In other words, if $(x) has a root in the unit disk, the N, can be expected to oscillate with ever 
increasing amplitude. If a>1, the N, converge to some limiting N. In the case a= 1, the Ni 
will eventually oscillate rather narrowly with an amplitude of about 1. 

Sections 7 and 8 call attention to the questions of utility to which one is led in the kind of 
situation under study. The technique proposed in Section 7 for handling more than one kind of 
plane settles little, save under very restrictive assumptions upon the availabilities of the two 
types of aircraft. Similarly, the questions which come to mind in connection with paragraph 8.1 
can be approached only in the presence of a lot of quantitative information and settled only when 
decisions have been made concerning the military utility of various procedures. The system 
problems, large groups of inoperative aircraft, sudden heavy demands upon repair facilities, 
etc., must be weighed against the need for rapid increases of operating strength. 

These questions are all important and should be studied. It is hoped that the present 
work may contribute to that purpose through its description of some of the underlying phenomena. 
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The author discusses the concept of a mission within the frame- 
work of the Theory of Games and analyzes a simple model, 











Few words are more often used in military circles than the word "mission."" But few 
words are more difficult to define precisely, One speaks of the mission of the U. S. Air 
Force, of the mission of a Naval Supply Depot, of the "operation of an actual support mission," 
of the mission of a logistics conference, etc. The word is so much taken for granted that it 
might even appear naive to devote a full paper to the concept of a ''mission."' In fact, the word 
covers so many different "objective functions," to use the jargon of the analyst, that the present 
paper studies only one very simple type of mission. But what it loses in breadth of vision, it 
wins in depth of understanding. 


PART I 


DEFINITION OF A MISSION 

The official military definition of a "mission" as given in the "Dictionary of United 
States Military Terms for Joint Usage" is the following: 

Mission. - 1. The objective; that is, the task together with its purpose, thereby 

clearly indicating the action to be taken and the reason therefor. 2. In common 

usage, especially when applied to lower military units, a duty assigned to an 

individual or unit; a task. 3. The dispatching of one or more aircraft to accom- 

plish one particular task. 

It is clear that these different meanings have some basic elements in common and in the 
present paper we will say that a mission implies the selection by an authority of an objective, 
usually well defined and which must be reached within a certain time period, through a chain of 
operations to be chosen and performed by the agents in charge of the mission and responsible 
for its successful conclusion, in spite of eventual difficulties and obstacles which cannot be well 
defined at the beginning of the operations. 

To take a simple example, the obligation put upon me to pick up a car at a factory before 
closing time on Friday, knowing that I can leave my work only on Thursday night and that the 
factory is 650 miles away, is a mission. In this case, the time period is precisely defined and 
the mission has none of the characteristics of a flow through time. This is true also in the case 
of any type of flight of the Military Air Transport Service of the U. S. Air Force. One type of 
flight, for instance, might be the obligation to carry 60 passengers from MacGuire Air Force 
Base to Frankfurt-am-Main. The flight should depart at a certain time, arrive at a specific 
time, and stop in between, if necessary, for refueling. 











1 This paper has been written at Princeton University under Office of Naval Research 
Contract Néonr-27009. 
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But in the more sophisticated case of logistics planning, the ''flow" character is essen- 
tial. For a Naval Supply Depot, for instance, a mission can be defined as the obligation to meet 
or fulfill a general demand for certain quantities of products. Under each mission, however, 
will normally come a series of requisitions or orders for products, ranging from daily orders 
to replenishment orders which may be many months apart. In all such cases, the necessity of 
associating a time reference to the mission and the requisitions is obvious. But the best way of 
doing it is a matter for discussion. 2 

In the present study, then, the concept of order will be considered as essentially the 
same as the concept of mission defined above, so that the concept of mission as used by the 
Navy covers really a flow of missions, in the narrow sense in which we use this word. It seems 
to us, however, that the restricted definition is useful for the purpose of the present paper 
because it is very precise and puts the emphasis on the functional aspect of the logistical situ- 
ations. This aspect is too often underestimated in the current literature on logistics, although 
it provides the key to the solution of many apparently complicated problems. This does not 
mean, however, that the macroscopic approach to the problems of logistics is not useful. In 
fact, we should tackle eventually the aggregation problem of reconciling our microscopic 
approach with the macroscopic one, since it is only at this latter level that suggestions or 
recommendations could be of real use. 





BASIC CHARACTERISTICS OF A MISSION 

In the definition of a mission, particular emphasis must be placed on the notion of 
selection of the objective. This implies that the objective selected at a given time by the 
Authority has priority on other objectives and, therefore, has also priority on the use of the 
resources at the disposal of the Authority. But the difficulties and the obstacles that the actual 
realization of the mission may encounter, and also the unavoidable changes in priorities which 
come with the evolution of dynamic situations, have an influence on the outcome of the mission 
and on its real value when it is completed. A distinction also must be drawn between the tech- 
nical feasibility of a mission at any cost and its feasibility within a maximum cost. The degree 
of priority given to the mission has a definite bearing on this problem. Moreover, the cost in 
question might not only be a money cost, but also a kind of psychic cost where the Authority and 
the agents have to force themselves, say, to analyze the relevant information which is available, 
perhaps at no‘cost in money, but supposing, on their part, in order to be useful, the will to think 
and plan. Also, once the mission has started, the penalty of failure} might be such that the 
Authority and the agents may be willing to forget altogether about cost when it is realized, in 
the course of the attempt to fulfill the mission, that the probability of failure has increased con- 
siderably for one reason or another not foreseen at the beginning of the operations. The inter- 
relationships between all these factors should be studied in more detail, and we shall try to do 
so in the course of the present paper. 

Another essential character of a mission is the notion of operations and of the mathe- 
matical sequence or order in which they must be performed. A mission supposes a set of 
operations which must be performed usually in a certain order4 but which have alternatives 

















2See O. Morgenstern, ''Consistency Problems in the Military Supply System," Naval 
Research Logistics Quarterly, Vol. 1, No. 4, December 1954, 
This concept will be defined more precisely in the course of the paper. 





4There are, however, certain subsets of operations which can be performed indifferently | 


in one way or another: filling a container, for instance, with products coming under the same 
order in a Naval Supply Depot. 
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involving different costs and which correspond to different courses of action, each course being 
any set of successive operations which leads to the successful completion of the mission. The 
completion of each successive operation opens a new subset of operations, one of which is 
selected in such a way that it entails, say, a minimum cost (money cost and psychic cost), given 
the information available and the risk of ultimate failure that can be accepted at any given time 
within the time period which has been fixed. 

Naturally, in order to bring the mission to its successful conclusion, some organization 
must be set up which must be adapted to the needs of the particular mission. This organization 
will draw on the environment and will make use in a rational way of the resources available, 
given the cost and the probable penalty constraints which are relevant at the particular point of 
time reached within the time period. 





IMPORTANCE OF THE THEORY OF GAMES FOR THE STUDY OF MISSIONS 

In many logistical situations, a mission can be assimilated to a move in the sense 
defined in the theory of games originally developed by O. Morgenstern and John von Neumann. 

In fact, the body of the Authority and of the corresponding Agents can be assimilated to a player 
in a kind of strategic game which could be called Race against Time, and in which a particular 
mission, when decided on, represents a move in the game. Naturally, in time of war, the other 
players of the game would be the bodies of the opponent authorities and of their agents who try 
directly or indirectly to nullify the expected results of the mission and who have missions of 
their own. Their corresponding moves involve also the use of Time as a kind of battlefield, 

the possession of which, or, rather, the most effective use of which, is vital for the final issue 
and the ultimate value of the operations. But the use of Time involves the use of other resources 
at a rate which can be measured relatively accurately and even forecasted in many cases by 
means of, say, usage data. The problem of the best use of Time is, therefore, closely related 
to the problem of the optimum use of resources. But for our present purpose, and since Time 
appears as the most valuable commodity to which all others are related, we can refer to the 
game visualized here as the game of the Race against Time. 

In time of peace, the actions of the different bodies of the authorities and their agents, 
i.e., the moves of the players, may not be quite as obvious as in time of war. But whether the 
logistical situations are brought about by the necessity either of keeping acquired positions or of 
attempting to win new ones, the essential structure of the game is still the same. Admittedly, 
the importance and the number of moves decided on per time unit are vastly different in time of 
war or in time of peace, so that the dynamics of the game may be quite different according to the 
volume and the scale on which the operations are conducted. In fact, the problem of expansion in 
war should deserve more attention than it receives generally, along with the problem of rapid 
identification and special handling of critical items in war, 

Such a general view of the meaning and purpose of logistical situations considered as a 
whole, however, is very often insufficient to provide good rules of action in particular situations. 
It is only at a certain level of abstraction of the over-all process of decision-making that methods 
of analysis and of behavior based on this approach could be helpful. This explains why, in partic- 
ular logistical situations where one move of the game is all that counts for the agents put in 
charge of a particular mission, other methods of rational behavior for the agents and of control 
for the authorities must be found which must be sound from the general point of view of the 
theory of games but also practical from the point of view of everyday use. 


























5Remark of Rear Admiral H. E. Eccles to the author. 
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Still, at this lower level of analysis, it seems reasonable to assume that to win means to 
fulfill the mission in the time allocated. But Time cannot be considered as a conscious human 
being who tries to thwart systematically the efforts of the Agent. It is just a name to cover 
what appears to be, for all intents and purposes, the substratum of the moves of the players in 
the game of the Race against Time as well as the stake of the game. A scale of values, how- 
ever, should be devised in most cases to weigh the importance of Time according to the type of 
missions and of logistical situations involved. 

Now, if the mission could be fulfilled as planned, with complete certainty, and if the 
information were complete and perfect, there would be no real problem, because the decision 
to make a move and the actual implementation of this move would be identical. The theory of 
games would then be fully adequate to provide methods of rational behavior in all cases. In 
fact, we would know in advance that the mission is technically and economically feasible, and 
all operations which constitute the mission could be determined before the start. There might 
even be different courses of action involving different costs, but they would all lead to the suc- 
cessful conclusion of the mission, and the cheapest course would be the best, provided the time 7% 
constraints were satisfied. In short, this would be planning, forecasting, and action under ideal | 
circumstances. 














In practice, however, to enlarge the horizon of planning costs money and effort. Very 2 
often all that can be done at first by the agents is to obtain a broad idea of the kind of operations | 
involved and of their rough timing, and to rely on the existence of possible alternatives in case : 
something goes wrong with the course of action which appears to be the cheapest. This means 
that the horizon of definite planning or, should we say, of relatively accurate forecasting, is 
shorter than the duration of the mission. In fact, it extends very often only to the first operation 
of the mission, because of the possibilities of direct or indirect interference of the other players . 
in the game, and also through the impossibility of obtaining all relevant information. Then, if © 
the first operation is completed within a certain time—if I get to the intermediate station in time 7 
to catch the next train, for instance—all is well and we can say that Time has lost the first round) 
of the actual implementation of the move decided on by the Authority. If it is not the case, Time 
has won, and the penalty is that the Agent loses the use of the cheapest course of action and must 
now embark on another course of action, more expensive than the first one. Then the effort to 
make the move starts again with another round, the Agent taking the course of action which is the 
least costly among those which in his opinion will bring about the ultimate success of the mission) 
And so on, until the end. The final success of the mission, i.e., the actual implementation of the 
move decided on, is achieved when it is known whether Time has been defeated for sure,© 





THE CONCEPT OF THE VALUE OF A MISSION 

One fact appears immediately to be important in the definition of the value of a mission. 
It is to know whether the mission once decided has been started and whether it is now too late to 
back out and to adopt another mission which might be better if it had to be decided all over again. 
In the latter case it means, presumably, that the cost of the mission already incurred up to the 
present time is too sizable, so that to start a new mission at this point would be too costly with 
respect to the expected supplementary advantage that could be obtained by embarking now on 
another mission. In fact, it can be assumed in many cases that to order the Agent to switch to 





6In the case of missions such as those given a Naval Supply Depot, it would also be nec- 


cessary that the right quantities of products required had been shipped and received at their 
place of use. 
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another kind of mission when one is already developing would not bring a supplementary 
advantage, but that the equivalent of the planned advantage visualized at the start of the mission 
can always be obtained by changing the planned course of action of the present mission: adopt- 
ing, Say, a more expensive course of action when it is realized that the expected breaks do not 
materialize or that the enemy has started a counteracting action of his own in answer to our 
mission. In this sense, the present mission may be turned gradually into another kind of mis- 
sion, but we can discard this fact and say, for all intents and purposes, that there is only one 
optimum mission attached to a given horizon of planning and that the present mission, once 
completed, is that one. This optimum mission, however, is defined at the start of the mission 
in terms of the a priori probabilities of the different courses of action and of the corresponding 
operations which compose the mission, these probabilities being really the subjective proba- 
bilities attached by the Authority to the probable actual realization of the operations. These 
probabilities, although subjective, have nevertheless a great importance, since it is on them 
that the Authority is prepared to make its decision as to whether the present mission is the best 
or not, and to bet its reputation of being fit for the job of taking this kind of decision. They can 
be looked at as the outcome of innumerable experiences similar to the one under development. 
Theoretically, the possible choices between the alternative operations at each stage of the mis- 











sion are potentially very great, since they are determined partly by the actions of the enemy 

who may have started a mission of his own to counteract the effects of our own mission and 
partly through chance, since there are some breaks that we can reasonably expect but which may 
not materialize. In practice, however, there are but a few possible operations and courses of 
action which really matter, and those are the only ones retained by the Authority in making its 
decision. These operations and courses of action are those which would appear again and again, 
and have the higher frequency, if the same kind of logistical situation and the same kind of mis- 
sion would be found in other places and other times. This set of operations, together with their 
timing and the probabilities attached by the Authority to their realization in time, is the oper- 
ational definition of the concept of a mission. 





Under certain assumptions, we can then give a more concrete meaning to the concept of 
the value of the mission. The expected pay-off or expected value of the mission is the difference 
between the expected value of the advantage of the mission and its expected cost. Let us show 
first how to compute the latter. 





THE EXPECTED COST OF A MISSION 

The chances of getting some breaks in the actual development of the operations of the 
mission can be taken care of very simply by imagining that the expected cost of an operation, 
once decided, can take different values, making this move more expensive than average, less 
expensive than average, or normally expensive, with given probabilities of realization in all 
three cases. Let us assume that these probabilities are all equal from the standpoint of the 
Authority. 

The different operations of the mission, however, do not have the same probability of 
realization from the standpoint of the Authority. Some courses of action have a greater proba- 
bility of realization than others and, naturally, the probabilities of realization attached to each 
last operation in the different potential courses of action are identical to the probabilities of 
these courses of action. If we assume that these latter probabilities are known, the probabili- 
ties of all the operations in each potential course of action also are known. It is then easy to 
compute the expected cost of the mission by weighing the average cost of each operation by the 
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corresponding probability of the course of action to which it belongs and adding up the weighted 
costs of all the potential operations. Naturally, we could also compute the average cost of the 
potential courses of action and weigh them by their respective probabilities of realization. The 
sum of these costs would also be the expected cost of the mission. 


THE EXPECTED ADVANTAGE OF A MISSION 

In many cases, instead of using the direct method based on the assimilation of the 
broad logistical situation to a game and of the mission to a move in the game, it seems possible 
to use an indirect method for the purpose of computing the value of the advantage of the mission. ~ 
In fact, if we make the assumption that the reason of a move is to force the enemy to make a 
corresponding move and to pay for his own move more than it costs us to make our own move, 
we have then a simple way to measure the advantage of a move: this advantage is equal to the 
cost of the move of the opponent. 

Naturally, the expected cost of the move of the opponent is not so well defined, usually, 
as the expected cost of the mission under consideration by the Authority. Experienced com- 
manders, however, can guess this cost well enough in routine situations, especially when the 
mission is sufficiently broad in scope. They may even guess this cost better than the opposite 
commanders themselves when their information on usage data and their knowledge of the ways 
to use it for planning purposes is better than those at the disposal of the enemy. But this method 
assumes implicitly that the Authority has the initiative of the move and this question deserves 
an explanation. 














DEFINITION OF THE CRITICAL MOVE 

In broad strategic situations, there are always many moves which take place more or 
less at the same time, and it is difficult to single out one particular move as being definitely 
responsible for a certain move of the opponent. To a certain extent, the preceding analysis has 
gone around this difficulty by assuming that a mission can be turned gradually in time into 
another one, and this is really a way to take care of a chain of moves such as those met in real 
strategic situations. This allows us to match the chain of moves of the Authority against the 
corresponding chain of moves of the opponent. As long, then, as the Authority is able to make 
the opponent pay more for his moves than what it costs for its own moves, we Say that the 


Authority keeps the initiative. If this trend if reversed, the Authority loses the initiative. Now, a 





to be in the position of having the initiative is important since it implies that the general develop- “ 
ment and the scale of the operations are at the disposal of whoever has the initiative. The move, 


whether it is a mission or an operation, which corresponds to that position where it is necessary | fs 





to let the initiative go to the opponent can be called the critical move. Naturally, the critical e 
cost is the actual cost of this critical move. It is also the actual cost of the move of the opponent | 
under the assumption made above that the advantage of a move is equal to the cost of the move of 
the opponent. It means also that the critical cost is equal to the respective advantages of both 
moves and that the expected pay-off of the mission is zero or close to zero when the mission is 
critical. 


DEFINITION OF THE PENALTY OF FAILURE 

This allows us to give a precise meaning to the concept of the penalty of failure. We can 
say that it is the discounted value of all the losses that the Authority will suffer at the hands of 
the opponent because of its failure to keep the initiative at a critical point in time, a loss being 
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the difference between the cost of a mission and the corresponding advantage when the Authority 
does not have the initiative. 

Naturally, this concept is general and can be applied to all sorts of strategic situations. 
In this paper, we restrict it to the set of a mission and of the successive missions that will fol- 
low the first one, perhaps against the will of the Authority because the mission under consider- 
ation has become critical. Eventually, the Authority may regain the initiative either directly, 
or, more probably, indirectly by attacking the enemy on another field and forcing him to lose 
the initiative. But this is another problem which cannot be considered in the present paper. It 
also might happen that the chain of moves which will follow the critical move will come to a 
natural end. The concept of the penalty of failure can therefore be very useful since the penalty 
can be computed most of the time, not always on a priori grounds except as an estimate but 
certainly a posteriori, when the chain of moves has come to an end. 

In the simple example given above of the mission which consists of picking up a car at 
the factory before closing time on Friday, it is the last operation of the mission which may 
become critical, i.e., the necessity, say, of catching a plane instead of taking the train as 
planned at the beginning, since we had missed the train connection at the intermediate station. 

If the fare of the plane had been such that it would not have been worth while getting to the 
factory on time but, rather, to proceed leisurely by train to the factory and to suffer the con- 
sequences, it would have meant that the extra cost of taking the plane would have been equal to 
or greater than the penalty of failure. The penalty of failure appears, therefore, as the price of 
failing to keep the initiative in time and of not meeting the time requirements of the mission as 
given at the start of the mission. 











PART II 











A SIMPLE MODEL OF A MISSION’ 

To illustrate the results obtained Sta ach at havea eeNlagciaiod wall Q! 
so far, we can draw a graph showing the Sia amiable aa ial Qn 
evolution of the cost of the typical mission g , 
described above as a function of time, as- @ [------------------------- peal Cn 
suming that the value of the advantage of 8 —n- | 
the mission has not changed during the Z : 
course of the mission (Figure 1). S ‘es | 

The Authority has to decide whether ” ; pe ; 
the mission is worth undertaking and the 9 quale ; 3 | 
two courses of action which seem possible ; : 
are as follows: either the Agent will go — P 2g | 
by train all the way or he will go by train y't-- ae -Grcccce secee * -ar- +} 1. 
all the way upto the last leg of the journey, 6 7 - 7 - t : 
for instance, and will then take a plane to oe 2 , rim ; 


completethe mission. But itis not certain 
whether a plane will be available. 


Figure 1 - Alternative cost curves of a mission 
compared to the advantage of the mission 





For the first alternative, the cu- OT = time allocated for the mission 
; : Qw" = value of the advantage of the 
mulative cost curve of the operations mission 
wy’ = penalty of failure if the mission 
- is not completed on time 
I am indebted to A. J. Hoffman for C;, Cz, C;, C, = normal cost curve of the mission 
his advice onthis point, and also to Michio C),C2,Cj, 2, = alternative cost curve of the 


Hatanaka. mission 
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performed at times ty, to, ---5t, ends up at the point Cc. on Figure 1. For the second alter- 
native, it ends up at the point Qy and the segment C12 represents the extra cost of taking 
the plane instead of going by train on the last leg of the journey. It is the last operation of the 
mission which may become critical in this case. 

The value of the advantage of the mission is represented by the ordinate 0w' = TQ'. It 
is the difference between the price of the car on the local market and the price charged at the 
factory. 


FIRST PROBLEM 

Assuming that the intermediate point where the Agent must make a decision concerning 
whether to switch from the train to the plane is known (the beginning of the last leg of the jour- 
ney, for instance), and given the subjective probability 7 in the mind of the Authority that the 
Agent will try to catch a plane when he reaches this intermediate point because he will not be 
certain otherwise to complete the mission on time, what is the condition which determines 





whether or not the Mission is worth undertaking? We assume, also, that the Agent will actually 3 





complete the mission on time if he decides not to try to catch a plane because he feels certain 
to complete the mission on time. 

Let p be the probability in the mind of the Authority that the Agent wili actually miss 
the plane if he tries to catch it. Naturally, if the Agent does not catch the plane, the mission 
cannot be completed on time but the Agent must finish it all the same by train. 


There are two cases to consider according to whether the Authority is certain (1st case) Ls 


or not certain (2nd case) that the mission will be completed on time if the Agent does not miss 
the plane. In the 2nd case, let e« be the probability that the mission will not be completed on 
time. Presumably, « is very small. 

Let A be the value of the advantage of the mission and C,_, the cumulative cost of the 
operations up to the last leg of the journey. Let also Ve be the cost of the last operation if the 
Agent goes by train and y . the cost if the Agent takes a plane; the difference y th, is repre- 
sented by the segment C n@n on Figure 1. Finally, let F be the value of the pefalty of failure 
if the mission is not completed on time for one reason or another. 

Before undertaking the mission, the expected cost of the mission is: 


(1) 4=C, 1 +(1- 7, +7 [1 -p)y, + 0G, + F)I 


in the Ist case, and 
(1)" A=C,t+(l-y, +7 [(l- 9), +eF)+ 0, +F)] 


in the 2nd case. 

The term in brackets expresses the fact that, if the Agent does not miss the plane when 
he tries to catch it (probability equal to 1 - Pp), the expected cost of the last operation is ¥, or 
Y%,* eF, according to the case, and if he misses the plane (probability 9) and goes instead by 
train although he knows that he should have taken the plane, then he pays the cost Ne and the 
penalty F. 

Reasonable values for 7 and p might be 3/4 and 1/4, for instance, and the value of « 
might be 0.05. 
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Now, the mission is worth undertaking only if the value of the advantage of the mission 
is greater than the expected total cost of the mission, i.e., if: 


(2) A-A20. 


This condition says also that the expected pay-off of the mission must be greater than or equal 
to zero. It is the condition we are looking for. 





SECOND PROBLEM 

At which intermediate point should the Agent try to switch to a plane? It is important 
that the Authority should tell the Agent at which point he has to switch to a plane if he is not 
sure to complete the mission on time when he reaches that point. 

There are several factors which influence the determination of the optimum interme- 
diate point, and a proper balance has to be found between their values. This balance is found 
when the expected pay-off of the mission is as great as possible or, what is the same, when the 
expected cost of the mission is as small as possible. Let us then consider the different param- 
eters which have an influence on the value of the expected cost defined, for instance, by equation 
(1) written as follows: 








A=C 1 tYn tt (%%-%,) (1-2) + PF 


4=C.+(y, - 7,) (1 - p) + pF 


where Cc. is the cost of the trip if it is made entirely by train. 

In this equation, we see that the probability 7(t) varies according to the intermediate 
point’ considered, because it depends on the estimate that the Authority makes of the chance 
events which may happen between the beginning of the mission and the time when the Agent 
reaches the intermediate point. This probability depends, for instance, on the chance of making 
good train connections at intermediate points before the point considered. In the same way, the 
probability p(t) varies also as a function of time. It depends, for instance, on the eventual state 
of the weather, since the plane will not fly if the weather is bad, or on the availability of regular 
flights at some intermediate points. Finally, the value of y a 7a varies in time. In fact, it 
could be approximated by a function g(t) defined by: 


t 
(5) g(t) = - >). 


where k is the value of the extra cost if the whole trip is made by plane and not by train and T 
is the total time allocated for the mission. 

If we could assume that these functions are continuous and well defined over the time 
interval, we see that the expected cost would be minimum from the point of view of the Authority 
when the derivative of A as a function of time is zero, i.e., when 





8We assume for the time being that the time scale and the point scale are the same. 
This is the reason of the symbols 7(t) and P(t), where t is the time. 
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dg(t) 


i 
dt 


[(1 - p) g(t) + pF) sas CF - e(t)] ae -p) 


dg(t) k 
Taking into account the value of *. “7 obtained from equation (5), this means that 


(1 - p) g(t) +r) S +a ([F - git) = - m(1 -p)==0. 


This condition determines thé point of time where the Agent should try to switch toa 
plane. In practice, however, the functions 7(t) and p(t) are not continuous and may not even be 
defined in a simple way at the beginning of the mission for the whole time interval. The con- 
dition which determines the equilibrium point is then more complicated. In fact, what we must 
determine is a good strategy, i.e., a method which tells us what to do in each case which may 
happen, This leads us to the third problem which defines a mission as a game where the player 
(the Agent) plays against chance. But we assume that the Agent knows the mixed strategy of 
chance, i.e., the probability distribution of the different strategies of chance. This means also 
that the probability distribution of the chance moves is known each time that the Agent makes 
himself a move. This generalization of the problem therefore takes into consideration the 
information obtained from the outcomes of the chance events so that the criterion for deter- 
mining whether to change for a plane at time t, for instance, depends on the known outcomes 
of the chance events which took place before t (like the making of train connections). 


THIRD PROBLEM 

The mission considered as a one-person positional game. ? 

A mission in the sense considered in the present paper is a positional game where the 
player (the Agent) plays alternatively and successively with chance. The position x of the 
game is the topological product of the intermediate point s where the Agent finds himself, the 
corresponding time t, the amount of money m still available for the mission, and the means of 
transportation & that he uses. The amount of money m is the difference between the total 
amount of money allocated by the Authority at the beginning of the mission and the amount which 
has already been spent by the Agent. 

Let X be the set of all the possible positions of the game, and [I 1%), Pg (x) two multi- 
valued functions from X to X; if, in a position x, the Agent has the move, Py (x) denotes the set 
of all the positions he can obtain theoretically at the next stage of the game; if, in the position 
x, chance has the move, Pg (x) is the set of the possible positions which can occur effectively, 
with a known probability distribution {p(y)/y € T'o(x)}. 

The mission succeeds if the Agent is at a place So before a time to» i.e., if the move 
belongs to the Agent, and if the position x lies in the set K = {(s, t, m, &)/s= Sp; t<tp; m 2 0}. 
In this case, the game comes to an end, and the payoff is f(x) = m. 

The mission fails if the move belongs to the Agent, and if the position x lies in the set 
K' = {(s, t, m, £)/s= So; t> to or m<0}. In this case, the game stops, and the payoff is 
f(x) = m - # where uw is the penalty of failure. The aim of the Agent is to obtain as high a 
payoff as possible. 








See J. Milnor, Contributions to the Theory of Games, Vol. II. 
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THE CONCEPT OF A "MISSION" 


If Xo = (So, to» Mo» “2 o) is the position of the game, it means that the Agent is at the 
station Sp at the time to with an amount of money Mo» and uses the means of transportation 
a (a train for instance). If the Agent has the move, he can choose among several means of 
transportation £,, £ e EY etc.... A position of Ty (Xp) will be x, = (s;, t;,m), Ex) where S} is 
the next station after So for the train & vp ty is the expected time at which the train is supposed 
to arrive at this next station, and m, - m, is the fare from So to S1- If the next position is 
Xo = (So, to, Mg, = 2) € P(X), we shall have Sp = S,, My = Mm), £o= £1, and ty is the time at 
which the means of transportation Ey (the train, for instance) has effectively arrived at the 
station S}- 

A player i's strategy o i is a univalued function from X to X such thato i(*) eT, (x) for 
all x. Let Z(0 9; 01) be the position of KU K' ("terminal position") obtained if the Agent plays 
with the strategy 7 and if chance "plays" with the strategy og: If PC 9) is the probability 
that chance will choose the strategy Fo» then the Authority must choose a strategy O71 for 
which the expected payoff defined by 


F(c,) = Z Pp) f [z(09, o,)] 
"0 


is as high as possible. If the space X is finite, it is well known that there exists a good 
strategy. !0 If X is infinite, i.e., in the case where T'9(x) or Py (x) are infinite sets of choices, 
there is not always a good strategy. We are going to show, however, that in the case where the 
mission can be represented by a topological game, there exists a definite good strategy and we 
shall give also a method to determine this strategy. These results have been found by C. Berge 
after a discussion with the author of the present paper. 


FOURTH PROBLEM 

Case where the mission is a topological game. !! 

Consider on a metric space S called "the sea'' a moving point s called ''the boat"' which 
is trying to reach a point So: There are areas on the sea which are forbidden, such as islands, 
etc..., and areas which are dangerous because the boat might be sunk by the enemy or be 
incapacitated. The probability p(s, t) of this possible event £ is supposedly known at each 
place for the time t. We note that if the captain of the boat (the Agent) must take a decision 
every minute, for instance, then we have a mission in the sense defined above. 

Let x = (s, t, m, £) be the position of the game, where s describes the place where the 
boat is, t is the time, m is the quantity of resources (fuel, etc...) still available, and — isa 
variable which describes the degree of incapacity of the boat (& = 1 if the boat is in perfect 
order, and & = 0 if the boat is out of order). The set PD, (x) is the set of all the posi- 
tions of the game that the boat can reach in one minute from the position x = (s, t, m, £) 
Supposing that — has not changed during that time interval; if = = 0, for instance, then 
I, (s, t, m, 0) = {s, (t + 1), m, 0}. The set l'g(x) is the set of the positions x' = (s‘, t' ; 





t', m’, &') 
which can be reached effectively instead of the position x = (s, t, m, £), i.e., such that s' = s, 
m' = m, t' = t, but &’ can be different from &. 





10See, for instance, for the finite ordered case, H. W. Kuhn, Contributions to the Theory 
of Games, Vol. Il, p. 209. 
‘See C. Berge, "Sur une généralisation du théoréme de Zermelo-Von Neumann," C. R. 
Ac. des Sc., tome 241, p. 455, 1955. See also, ''Topological Games,'' Colloque of the Int. Conf. 
of Math., Vol. II, Amsterdam 1954. 
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The aim of the Agent is to reach a position x (with the move to the Agent), = lying in 
the set , 


K = {x = (s, t, m,£)/s = Sp; t<tp; m2 0}. 
Let us define the set K' such that 
K' = {x =(s, t, m, £)/s #89; t>tg or m<0}. 


The game terminates if the position lies in KU K' (with the move to the Agent). 

The payoff is the characteristic function of the set K, i.e., the function 
f(x) = 0 if x¢ K, f(x) =1 if xeK. 

The game is a one person topological game, since the space X is the topological 
product S x T x Mx [0, 1] of four topological spaces, and My, Tg are continuous multivalued 
functions on X to X; moreover K is a closed set in X, and the payoff function f(x) is, there- 
fore, an upper semi-continuous function on KU K'. It is not assumed that the alternative sets 
be finite, or that there should be a uniquely defined path leading from a given position Xy to 
another X93 but it is assumed that if a position x occurs at a time to then the same position 
xX cannot occur at a time ty # to: Moreover, if the game is a mission, the lengths of the plays 
are bounded. 

Under these assumptions, it seems important to study whether there exists a good 
strategy o}- 

Let z(x, i, > %) be the last position of the game when the initial position is x, the 
Agent adopting the strategy o> chance adopting Oo and i denoting the player which has the 
move at the beginning of the game. If P(o9) is the probability attached to the strategy Oo the 
expected payoff, for the Agent adopting the strategy 94; is 





F(x, i, 01) = & P(op) f (z(x, i, o> 0)] : 
0 


A multivalued function [(x) from a topological space X to a topological space Y is said to be 
upper semi-continuous if 
1° T(x) is a compact set for all x in X; 
2° r*(Q) = { x/xeX;1(x)#o: the empty set; [(x) 4; ['(x)<Q} is open for all open sets 
Qin Y. 

THEOREM: Given a mission for which X is a topological space, f(x) is an upper 
semi-continuous function on KU K', P(x) and Tg (x) are upper semi-continuous multivalued 
functions on X, { p(y)/ye Tg (x)} is a continuous probability distribution, then there exists a good 
strategy % for the Agent. 





PROOF: Consider the sets 
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THE CONCEPT OF A "MISSION" 57 


Cor is the set of all the positions at the time to-k (with the move to the Agent). It is possible 
to assume that KU K' is an open set (if it is not so, one can use the method of the "topological 


m 
sum"). The sets Cy, are open, disjoints, and X= wom: 


We shall define % successively on Co Co,Cy, ...3 0, will be defined on Co by 
0, (x) =x; if o, is defined on Co, 9; for every x in Cor» one will take o (x) = y such that 
ye ry (x), and 


Fly, 0,0,)= max F(z, 0, 1); 
Ze Ty (x) 


y exists if F(z, i, 04) is an upper semi-continuous function for i= 0, 1; it is therefore neces- 
sary to prove that it is so. Let us assume that it is true onC, _, and let us show that it is still 
true on Cy. 

One has: 


F(Xp, 1, 01) = max F(z, 0, 04) 
ZE Py (Xp) 


F(X, 0, 0,)= > p(z) F(z, 1, 0). 
ZE T'9 (Xo) 


Consider the open set 
Q= {z/z eCy 43 f(z, 0, o,) < My + e} 
where: 


My = max f(x, 0, 01) ; 
X€ Ty (Xp) 


There exists a neighbourhood V(x) of Xo such that 
Xe V(X) implies Py(x)cQ 
Thus, 
XE V(x) implies F(x, 1, 01) < Mo +€; 
F(x, 1, 04) is therefore an upper semi-continuous function on Cc, (and, of course, F(x, 0, 01) 
is also an upper semi-continuous function on C,). In the case of the problem of the boat, the 
Agent has therefore a definite good strategy, according to the theorem above, if the set of all 


the prohibited places is open in S. A construction of the good strategy o% is given in the proof 
of the theorem. 
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VARIOUS OPTIMIZERS FOR SINGLE-STAGE PRODUCTION 


Wayne E. Smithl 





The following note develops theorems which enable one to sched- 
ule operations on a single-stage production system so as to minimize 
certainfunctions or optimizers. It is shownthat the maximum tardiness 
of job completion is minimized by ordering the jobs according to the date 
the job is due to be completed. The sum of times until each job is com- 
pleted may be minimized under various conditions. If all jobs can be 
completed by their due dates, a weighted sum of completion times can 
be minimized, subject to all jobs being completed by their due dates. 
This is done by scheduling last the jobs with the largest ratio of process- 
ing time to weighting factor among those jobs which will be completed 
on time if scheduled last; the next to last job is scheduled by applying 
the same rule to the remaining jobs, and so forth, until the complete 
ordering is obtained. 











In the process of production scheduling there are so many factors that must be taken 
into consideration that the determination of a best schedule is impossible without a very precise 
meaning of the word "best." We shall discuss some fairly simple criteria which might be used 
as a means of judging whether or not a schedule is good. We shall also show how the choice of 
an optimizer will affect the characteristics of best schedules, in certain special cases. 

We shall be concerned with single-stage production and with optimizers such that there 
is never any advantage in delaying the completion of any operation, unless the completion of at 
least one other operation is moved forward. It is not difficult to see that a schedule is then 
completely determined by the ordering of the objects to be processed; that is, an optimal solu- 
tion subject to a given ordering is obtained by performing each operation as soon as possible, 
consistent with the ordering. 


SECTION I 


In most of the scheduling with which we will be concerned, we establish sufficient con- 
ditions that an ordering will be a "best" ordering in some sense of the word. We wish now to 
establish a sufficient condition that we shall use repeatedly. 

We assume that the desirability of any schedule can be measured, and that this measure- 
ment can be expressed as a function f over the set of all schedules. Since the schedule is 
assumed to be completely determined by the ordering, then f can be considered as a function 
of the ordering or as a function over the set of permutations of the n objects to be processed. 
We wish to find a permutation 71, where 7 is the order (m,, Tore +ss Ty)» which minimizes 
the value of f. 





1 Prepared while the author was under contract to the Office of Naval Research, Logis- 
tics Branch, and employed on the Management Sciences Research Project, University of Cali- 
fornia, Los Angeles. The author wishes to thank Dr. J. R. Jackson and A.J. Rowe for their 
helpful suggestions and comments. 
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THEOREM: A sufficient condition that f(7) < f(7) for all permutations 7 of the n 


objects is that: 

(A) there is a real-valued function g of ordered pairs of elements such that if 7 is 
any permutation and 1’ the permutation obtained from 7 by the interchange of the 
i-th and (i+1)-st elements, then f(m) < f(1') if g(t, 7,3) < 8(m;,1, 7;) and 

(B) a is such that the i-th object precedes the j-th object if g(i,j) < g(j,i). 


PROOF: Given that the permutation 7 satisfies condition (B) we wish to show that 
any = 7 m7 can be altered by a series of interchanges of pairs of adjacent elements in such a 
manner that the value of the function decreases or remains the same at every interchange. 


Since 7 7 7, there is an element 1; of a such that 1; is immediately preceded by an item which c 


follows 1 in the order 7. (For example, 7, may be the element appearing as 7,, where the 
j-th position is the first position at which m7 and 7 do not agree.) Therefore, g(t ;, T;_4) < 

g(t; 4, 7;) so we may interchange 7, and 7; _, in the permutation 1, obtaining a new permu- 
tation m' with f(7') < f{(1). Also m1’ has one fewer pairs of elements which disagree in order- 
ing with those of 7. One may proceed inductively, decreasing the number of pairs of elements 
which disagree in ordering with those of 7 and at each step decreasing the value of the function 
or leaving the value of the function the same. ; 

The proof becomes more simple if g is a function which relates the elements ina 
transitive manner, that is if g(i,j) < g(j,i) and g(j,k) < g(k,j) together imply that g(i,k) < g(k,i). 
However, this is not necessary, as can be seen from the example in S. M. Johnson's paper [1]. 

It may be possible to simplify the function g so that it is a function of only one of the 
elements. In this case rule (B) becomes: 7 is such that the i-th object precedes the j-th 
object if g(i) < g(j). This does lead to a transitive relationship and is the type of relationship 
that is found in most of the following examples. 

We have not stated any method of obtaining the function g. In the following examples 
the function g is derived from the function f. Upon interchanging the i-th and (i+1)-st ele- 
ments of a permutation, the value of f changes by a certain amount. If this change can be 
attributed to quantities attached to just the i-th and (i+1)-st items, then one may be able to 
eliminate constant values from both values of the function f, obtaining f(7) = A+B a(n; Ti +D 
and f(n') =A +B g(t; +b 1), where n' differs from 7 only by the interchange of the i-th and 
(i+1)-st elements. It may then be possible to simplify this by finding a function h such that 
g(i,j) < g(j,i) if h(i) < h(j). 

In the specific examples that follow we shall assume we are given the operation times 
(which shall include the setup times except in Section VIII) for a finite number of jobs. Also, 
the optimizers with which we are concerned are such that the deletion of all idle times cannot 
make a schedule worse so we shall assume that no idle time occurs. 


SECTION II 


We now assume that each operation or job has a due date and that we wish to minimize 
the maximum tardiness. This type of optimizer might be used if the output of the machine is 
used in an assembly line production system where the delay on the assembly line is the maxi- 
mum of the individual delays. 

We let T; be the operation time of the i-th object and Di be the due date of the i-th 
object. If the objects are processed in numerical order the tardiness of the i-th object is: 
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VARIOUS OPTIMIZERS FOR SINGLE-STAGE PRODUCTION 61 
6; = T,+T,--- +T,-D,. Let A= max {5;} over i= 1, 2,...,mn. Our problem is to find 
an ordering which minimizes A. 


the § THEOREM:2 The order {1,2,3,...,n} is an order which minimizes A if 
D,< Dy * Dg< preg D,: 
PROOF: Let 7 be the order 1, 2, 3,...,n, and let 7' be the same order except with 


. : : = , a t : : : ‘ = , as U 
i and i+1 interchanged. Thus T; = T; and D; = D; for j gi or i+1; T; Ti+. Tis = T;» D; 


= Di,; and Di,,= Dj. Also, 6,= 6; for j#i or itl, Thus A< 4’ if 
Max (5;, 5;,,) < Max (61, 6,4). 


1 


This is by definition equivalent to: 















M (ST D Boar D..,) < M (57 D: Sr D:,) 
Pe ax ( - D,, .- D, < Max(z T;-D,, 5 T;-D,.,). 
3 j=l ; 7 j=1 j “itl j-1 js j-1 ? i+] 
Ee 
i Replacing the T; by their equal Tj values we have: 
yi). ie 
1). Y. i i+1 i-1 i+1 
5 a i+1 
ip ee Subtracting from each side R T; 
s Gf 
- Max (-T;,; - Dj, -D\,,) < Max (-T; - Di,,, - Dj) 
. or 
y) 
id -Min (Ti44 + D;, Ds 41) < -Min (T; + Dist . D,) 
t F 
or 
es | 
so, Ff Min (T; + Dis1 ss D;) < Min (Ti44 + D:; Di 41) : 
inot 
Since all T; are positive, if D; s Di 41 this condition is met, the D; being the smallest of the 
four terms concerned. Therefore, if D; s D; +1 we have that A < A’, and the order with i 
preceding i+1 is as good or better than the order with them interchanged. We have, then, by 
the theorem of Section I, that the maximum tardiness can be minimized if the jobs are arranged 
nize according to their due dates. Thus, if it is possible to complete all the jobs by their due dates, 
is this can be done by ordering them according to due date. 
axi- 
th 





23. R, Jackson [2] has generalized this theorem to take into consideration restrictions 
on the time at which the processing of each item can start. 
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SECTION III 


In scheduling for single-stage production, there is a waiting time, a time that each job 
must wait until it can be processed. Thus, if the objects are processed in numerical order, 


the waiting time for the j-th object is £ T;- One optimizer that may be considered is the 
i=1 
n j-l 


sum of all waiting times, = <£ T,. The minimum of this expression occurs at the same 


n j 
time as the minimum of the expression = 2 Tj occurs, since the two expressions differ 
j=1 i=1 


n 
by the constant, > T; . We shall use the latter formulation in this paper. 
i=1 
If the objects are processed in numerical order, the completion time of the j-th object 
j 
is C; = PA T; . We see that the above problem is the same as the problem of finding an order 
iz 
n 
which minimizes the sum of completion times, Z C; ; 
i=1 
n 
THEOREM: 2 Cc; is minimized over all orderings of the n objects if the objects 
i=1 
are arranged in increasing order of values of T;- 


n n i n 
PROOF: = C,= = ©£ T,= Ff (n+l1-j) T,. According to Hardy, Littlewood and 
izt ! ia j=1 J jan j 


Polya (Inequalities, p. 261), such a sum is least when the series are monotonic in opposite 
senses. Therefore, the optimizer will have its minimum value if T,< To < T3 Ss aoc The 


SECTION IV 


We may now generalize the theorem of Section III. Since some jobs may be considered 
more important than others, we may weight the jobs accordingly and consider a weighted sum 
of completion times. Weighting job i by an amount a;2 0, the optimizer is then of the form 

n 
SF aj C;. 


n 
THEOREM: Thesum [f aj C; is minimized over all orderings of the n objects if 
j=1 


the objects are arranged so the T,/a, form a non-decreasing sequence. 


PROOF: Let a be the order 1,2,3,...,n and let m' be the same order except with i 
_ ' _ ' = ah ' _ , 
and i+1 interchanged. Thus Tj = Tj and aj = aj for j #i or i+l; T; = Tia Tia = T;> 


= Aisp> Aad = aj. Also C, = Cj for j #i or i+1. Now, the order 7 is as good as or better 
than n' if 


n n —— 
o1 ajC; < 21 aj C; ‘ 
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VARIOUS OPTIMIZERS FOR SINGLE-STAGE PRODUCTION 
By the above equalities, this is true if 


t ’ ' ' 
ai Ci + ai Ciyy © aC Et Airy Chay 


or 


( i ) (3 i-1 (= 
S13 Fel ey = Tort a 2 “T; +f, +O 2B Ey. 
i j=1 j i+1 j=1 j i+1 j=1 j i+l i j-1 j 


i-1 
+1 ( 5 T; + Ta] from both sides this becomes 


i 
Subtracting a,( 2 T,). a, j i 


j=l . 


(1) Mia Ty < Tia: 
If a; and aj4, are not zero, we may divide by their product obtaining 


(2) T/A, < Ty4y/8j41 - 
Defining T/0 to be infinity, condition (1) and condition (2) are equivalent whether or not any a's 
are zero. 

Therefore if condition (2) is satisfied, the order with i preceding i+1 is as good as or 
better than the order with them interchanged. Thus, by the theorem of Section I, the minimum 
value of the optimizer is obtained if the objects are arranged in increasing order on T,/a,;- 


SECTION V 


We now propose to use the same optimizer as in Section III, the sum of times until each 
job is completed, but add the restriction that each job must be completed by its given due date, 
D.. 

THEOREM: If all jobs, 1,2,3,...,n, can be completed by their respective due dates,3 
then there is an ordering of the jobs with the k-th job last which minimizes . Cc i? subject to 
i=1 
completion of all jobs by their respective due dates if, and only if, the k-th job has the prop- 
erties: 


n 
(i) D, > = T. and 
k iz 


T;. 


(ii) T, 2 T, for all i for which D; > Zz 


ys 


PROOF: Let 7 be the ordering 1,2,3,...,n, and let it be so chosen that with the objects 
in this order all jobs can be completed by their due dates. Let I, be the set of indices for which 


n 
D; z RA T;- Since the ordering 7 is such that all jobs are completed by their due dates, we have 
1= 





3We stated in Section II that if a set of jobs can be completed by their due dates, this can 
be done by ordering according to their due dates. 
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that n is in the set I. Suppose that k is the index of the object with the largest value of T; 
for i in the set I: (If this is not unique, we choose one arbitrarily from those which are the 

largest.) Now let 7' be the ordering obtained from 7 by interchanging the k-th and n-th 

terms. Thus T;= Tj and D, = Dj for ifk or n; T, = T), T, = T,,, D, = Di, and D, = D,. 


j j 
Now for j<k, C\= 5 T\= = T, =C,, and since T, > T_ we have for k <j <n, C; = 
ae ee a ie. di 


j ' ' a : 


n n 
the sums of C's, we have that 2 Cj i - C;. Also, all jobs are completed by their respec- 
i=l i=l 


tive due dates under the new ordering, since for i ¢ k or n we have Ci < C.< D; = Di; 
Cc 


n 
T z T, < D, = D,- 


<D, = DB, and ee 


i 
"ia 


n 
In the particular case that 7 is an ordering which minimizes z C;, we have found an 
i= 


ordering m' which also minimizes the optimizer. Thus, if the k-th object has properties (i) 

and (ii) there is an ordering of the jobs with the k-th job last, which minimizes the optimizer & 

subject to completion of all jobs by their respective due dates. fA 
If the original ordering 7 has a last item which does not have property (ii), then TAT 


> a 42a 


- «b> «exec 


n n 
and in the above steps for k< j<n, C; < C; so that 2 Ci < Z C;. Thus 7 cannot be an 
i=1 i=1 
ordering which minimizes the optimizer. The ordering 7 is not even admissible without 
property (i). a 
In order to obtain a complete ordering which minimizes 2 Cc. » we can determine an 
i=: 


~ 


iz 
item to be scheduled last, one which has properties (i) and (ii). Once having determined the 


n-1 
last item, Ch is fixed, and we have the problem of ordering n-1 jobs so as to minimize 2 C;, 

i=1 
subject to the completion of all jobs by their respective due dates. Applying the theorem again, 


we can determine the last of these n-1 jobs. Continuing in this manner, we can find a complete 

ordering which minimizes the value of the optimizer. a3 
We note that if the objects are arranged in increasing order on T, and still meet their t 

due dates, then one cannot decrease the value of the optimizer by rearrangement, that is, the value © 

of the optimizer for this order is a lower bound on its value no matter what the side restrictions a 

are. 


vont oe — 


E 

¥ t 

On the other hand, if the objects are arranged in increasing order on D;; and this order = V 
t 

€ 


j 
is such that Di-1 «2 Ts Dj for all j (taking Do = 0), then the given order is the only 


arrangement by which all jobs can be completed on time. t 
SECTION VI 
The results of Sections IV and V can be combined to give a method of ordering so as to 


n 
minimize the weighted sum z a; Cc. subject to the restriction that every job must be completed 
is 
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r. by its due date, that is, Cc; < D;. If all jobs can be completed by their due dates, an order which 
the minimizes the weighted sum may be obtained. This order has as its last job one with the largest 
value of T,/a; from among those with due date as large as the total processing time of all jobs. 
He Proceeding as before, one can determine the last of the remaining n-1 jobs to be processed and 
continue in like manner until the complete ordering is determined. 
LT 
as SECTION VII 
ing Rs . ' 
2 Other optimizers that have been considered are: 
n 
ec - Total tardiness = = max (0, C; - D;) 
i=1 
n 
Weighted tardiness = Z a; [max (0, C; - D;) }. 
i=1 
<4 Thus far we can give solutions only in special cases. For example, if all the T; are the 
id an a same, the total tardiness is minimized if the objects are arranged in order of due dates. If the 
(i) ee objects are arranged in order of due dates and then have only one tardy item, this order mini- 
izer ce mizes total tardiness since it has minimized the maximum tardiness. In minimizing total 
me tardiness, a rule for the ordering of two adjacent operations is as follows: If the first of the 
Ty es i-th and (i+1)-st operations start at time t,, and if max {D;, t, + T; }< max {D.,,,t,+ Tj,1}> 
_ then the order {i,i+1} gives no greater total tardiness than the order {i+1,i}. Since this rela- 
F tA 
’ tion depends on to» one cannot in general expect to reach the optimal solution by only a series 
of interchanges of adjacent items. 
SECTION VIII 
an 
he 


Be Thus far we have considered only the case where the setup times could be included as 
-1 a part of the operation times. Under these assumptions, the over-all completion time of n given 

. jobs is fixed and is just the sum of the T;'S, regardless of order. Now let us see what type of 
problem we have if we wish to minimize the over-all completion time of all jobs where the set- 
up times are taken into consideration. 





4 Since the sums of the actual operation times is constant, and the over-all completion 
heir | time is determined by the sum of operation times and setup times, our problem is equivalent to 
e value : minimizing the sum of the setup times. This is a non-symmetric "traveling salesman" type of 
ictions © problem. To be more precise, the amount of setup times required for the j-th job, if it follows 
% the i-th job, is taken to be the "distance" from i to j (not necessarily the same as from j to i). 
order be We then have the problem of finding a cycle or "tour" starting with 0 (the original setup), passing 


through each object once, and only once, and returning to 0, which minimizes the distance trav- 
eled. (If one does not care in what form the machine is set up at the end of the operations, then 
the distance from j to 0 would all be taken as zero.) Since such problems have been discussed 
elsewhere, we shall not consider this problem further [3, 4]. 
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SECTION IX 





The optimizers for which an optimum ordering has been found in this paper are such 
that the solution can be obtained from any order (satisfying the given restrictions) by a series 
of interchanges of adjacent operations, improving (or not making worse) the value of the opti- 
mizer at each step. Thus there are no "local" optima with respect to permutations of adjacent 
elements. We have shown that any optimizer which satisfies the conditions of the theorem of 
Section I also has this property. Although it should not be too difficult to test to see whether 
specific optimizers satisfy these conditions, it would be desirable to characterize more com- 
pletely those optimizers for which no "local" optima exist. Further research is planned in 
this direction. 

Another difficult problem to be considered, of course, is that of finding how to determine 
an order which minimizes the value of similar functions when several machines or stages of 
production are used. 


REFERENCES 


[1] Johnson, S. M., "Optimal Two- and Three-Stage Production Schedules with Setup Times 
Included,"' Naval Research Logistics Quarterly, Vol. 1, No. 1, 1954, pp. 61-68. 

[2] Jackson, J. R., "Scheduling a Production Line to Minimize Maximum Tardiness," Research 
Report No. 43, 36 pp, Management Sciences Research Project, University of California, 

Los Angeles. 

[3] Dantzig, G., Fulkerson, R., and Johnson, S., "Solution of a Large Scale Traveling Salesman 
Problem," Journal of the Operations Research Society of America, Vol. 2, No. 4, November 
1954. 

[4] Kuhn, H. W., "The Traveling Salesman Problem," Proceedings of the Sixth Symposium in 

Applied Mathematics of the American Mathematical Society, McGraw-Hill Book Co. 














ARE tee Ae Sk 


es 





NOTES ON THE THEORY OF DYNAMIC PROGRAMMING 
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1 of = 
her a The theory of dynamic programming is applied to a class of 
om- 4 problems involving maximization over discrete sets. The solution is 
™ made to depend on the solution of a class of functional equations. 
ermine : 
: of _ INTRODUCTION 
: A problem of frequent occurrence is that of determining the maximum of a function 
% F(X}, Xo -++5 Xp) subject to the constraints 
: (a) G; (x1, Xo, ---» Xy) <¢;,i=1,2,...,K 
(1) 
(b) x; € S;, 
where Si is a discrete, usually finite, set. The most important case is that where each S; isa 
- finite set of integers, and an interesting sub-case is that where Xi = 0 or 1. 
A particular class of problems of this type concerns the maximization of 
sears) F (x)= = F, (x) 
xj = o (Xe 
a, . ica ii’ 
"over the set of x, constrained by the relations 
esman i 
rember N 
3 fa) Z G,, &,) <c,, 1=1,3,...,8 
: ja i i 
min — (3) 
2 
3 (b) x, €S,i=1,2,...,K, 
7 


with Gj (x;) 20 for x; € Sj» Gij (0) = 0, and Oe S; for all i. 


Even in the case where the F; and G.. are linear functions of the Xis this problem at 
the moment escapes any of the standard computational algorithms of linear programming, such 
as the simplex method of G. Dantzig. 

We shall show that this problem may be treated by means of the functional equation 
technique of the theory of dynamic programming [1], and that this technique yields a very sim- 
ple computational solution whenever the number of constraints is small. 

We shall also indicate the application of the method to a problem involving mutually 
- exclusive activities. Here we have an additional constraints of the form 


Ri caciPaOr ete ae Se: 


Sonar ee eee 


mB (4) X,%i4, =0,1=1,2,...,N-1. 
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FUNCTIONAL EQUATION 
Let us define the sequence of functions 


N 
(5) fy (Cys Cgr-+ +> Cx) = Max = F; (x,), 
{x} i=l 


where the x; are subject to the constraints of (3). Then 


(6) fy (c,, Coy-++s Cy) = Max F, (x,) 
x 
1 


(a) Gi (x,) ECyy-+05 Gx (x) <Cy, 
(7) 
(b) x, € S; . 


Applying the principle of optimality, we obtain the recurrence relation 


(8) fn (c}, Coy-+ +5 Cy) = Max [Fry %y) +iy 4 (c,-Gin (Xy),---5 CK - Gay (x,y) )], 
x 
N 


where 
(a) Gin (Xpy) < Cyy- ++ > Geng (Xy) SCR - 


(b) Xn € Sy - 


EXAMPLE N 
Consider the problem of determining the maximum of Ly (*) = = a, x; subject to the 
constraints i=1 


(9) 


(10) 
(b) x; = Oorl, 


where ai, b; >0. 


Here 
f, (c) =a,,c2b,, 


(11) 
=0,c <b, " 


and 


fy (c) = Max [any %y + fy 1 (C- by Xp) J, c2by 
Xp = 0,1 


=fy_1(e), ¢<by. 
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THE THEORY OF DYNAMIC PROGRAMMING 


DISCYSSION 
The functions fy (c) may now be computed with ease on either a digital or hand com- 


puter, depending upon the size of the system, starting with the known value fy (c). 

To give an example, suppose that N = 50 and c = 200, with the ai, b; integers ranging 
between 1 and 10. The naive approach involves the testing of 2“ sets of values, i.e., all pos- 
sible combinations of accept or reject. Since 250 2 19°(-30) = 104 5. this is a considerable 
task. Conventional linear programming techniques fail because of the restriction that the Xj 
be integral. For the case where N = 50, a round-off of the linear programming solution may 
cause considerable error. 

Using the above method, we must compute 50 functions {fry (c)}, each containing 200 
entries, c = 1, 2, 3,---. Ifthe a and b; are irrational, we may have to refine the c-grid 
in order not to introduce round-off errors of importance. An important point to note is that 
doubling the size of N will double the computational time, which is to say that the time required 
for computing the solution in this fashion is proportional to N, rather than dependent upon N in 
some exponential fashion, as in ordinary search methods. 

In return for the labor expended in computing the sequence fy (c), one has all the advan- 
tages of a "sensitivity analysis."' It is easy to trace the influence of c and N upon the maxi- 
mum value and the behavior of the maximizing Xy = Xy (c). 

Let us now discuss in more detail the remark we made in the introduction stating that 
this technique is, at the present time, restricted to problems involving a small number of con- 
straints. ! 

Consider a cargo-handling problem in which we have a number of items possessing 
values Vi» weights Wi» and sizes S;- We wish to maximize the value of the cargo carried, 
subject to weight restriction w and a volume restriction s. 

The mathematical problem is that of maximizing 





N 
(13) L(x)= 2 xX, V;, 
i=1 


subject to the restrictions 


N 
(a) RA xX, Wi <w, 
{= 
N 
(14) (ob) 2 x,s,<s 
ian ** 


(c) x, =0,1,2,... 


Defining 


(15) fn (w, s) = Max L(x), 


we readily obtain 





lWe have recently developed a new method, based upon a combination of the Lagrange 
multiplier method of classical variational theory and the functional equation method of dynamic 
programming, which greatly enlarges the scope of the methods presented here. A discussion of 
these methods will appear subsequently. 














RICHARD BELLMAN 
f, (w, s) =v, Min ( [= a |= > 
f, (w, plies [v,. X, + fy. (W- XW, S-%, 8) ], 


where R is the set 


(17) » Min ( [> aD (= s,))- 


Taking the parameters Wis Sis and v5 to be integers, we will, in general, be required to 

N functions of two variables, tabulated at the points of a grid w = 0, 1, 2, » W,s = 0, 1, 2, 
, 5. If W and S are of the order of magnitude of 100, this requires 10° ‘ai. This is 

Still within the capability of modern machines. 

It is clear, however, that one additional constraint of the same type puts us in the 10 
range. This exceeds the capability of any present day machine. 

If, on the other hand, there are a large number of constraints, each with a small range, 
then the method is useful. 


6 


EXAMPLE—MUTUALLY EXCLUSIVE ACTIVITIES 
Consider the problem of the preceding section under the additional constraint 


(18) X,Xi,,=9, i=1,2,...,N-1 


Define the sequence of functions 


N 
(19) n (¢, b) = Max Nd a; X; 


where the x; are subject to the constraints 


(a) x.-b=0, b=Oorl 


n 
(20) 


N 
(b) = b; 4c: 


Then we have the recurrence relation 


(21) fy (c, b) = - , nu 2nt fy 1 (C - Dy Xy; Xn) ] - 
Xy=0, 


To determine the solution we must compute the double sequence {fy (c, 0), fn (c, 1)}. 
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ATTRITION GAMES 
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This paper is a summary report of investigations of C. Tompkins, 
the authors, and others concerning rather general mathematical models 
of military situations. The basic assumptions on the mechanism of 
attrition are given by certain differential equations modified and gen- 
eralized from the classical Lanchester equations by R. N. Snow, 
C. Tompkins and the authors. PartI deals withthe attrition equations and 
is thus a study of a family of stochastic processes. It is also the study 
of combat wherein strategy in a game theoretic sense does not enter; 
the combat is described by physical constants expressed as probabil- 
ities--no provision is made for rational choices by the players. 


ed to 
ly 2, 
; is 


10 


Parts II and III deal with games, i.e. minimax problems, which 
isolate certain aspects of the problem of military (strategic, tactical, 
or logistical) decision. In Part II the decision means the commitment 
of a part of the available force to battle, retaining the remainder as a 
reserve, In Part III the forces are in the field, and the decision means 
a distribution of the fire of each type of unit among the several possible 
types of targets. PartIVis devoted tothe problem of estimating intrinsic 
values of weapons. Results from Parts I and II, along with related work 
by R.H. Brown, are employed to motivate a linear estimate for weapons 
of one type against one enemy type. This estimate is then generalized 
for the case of several weapon types. 


ange, 








More precise details are given in the introductions to the indi- 
vidual parts of the paper. It will be clear to the reader that this paper, 
while contributing somewhat to the study of attrition and military deci- 
sion, presents several unsolved problems. Of particular note are dif- 
ficult computational problems on a theoretical level, 














mare , 
RE 5. a tee 
ARTE PONE, Been 


io bi pene 
rasp ae 


PART I - ATTRITION PROCESSES 


eee 


In this Part we are concerned with bivariate stochastic processes based upon probabil- 
ities of survival of individual units. We summarize work of various authors [9, 11, 12] with 
some added results and comments. The central problem is to determine P(x, £; r,p; t) for all 
arguments non-negative and x, £, r,p integral; P is the probability that at time t, (x, =) units 
survive of (r, p) which began at t = 0. With the exception of I.4, we consider homogeneous attri- 
tion: individual units available to a player are identical but not necessarily like units available 
___ to his opponent. In I.1 we consider a probabilistic case: P is positive for t >0,0< x <r and 
Bm O<és p. We give a partial solution in closed form for a special case (I.1.6) and indicate that 
numerical computation of the general case appears promising. We next introduce a truncated 
process, Section I.2, in which we ignore the behavior of the process in time in favor of the 
direction of travel of the system. This process yields to analysis and is justified somewhat by 
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conclusions we draw from subsequent games. Section I.3 treats deterministic processes of 
which the Lanchester equations are standard examples. Finally, the non-homogeneous attrition 
of Section I.4 is based on Ref. [11]; we limit our consideration to aspects required for Part III. 





1. PROBABILISTIC ATTRITION 

We consider a homogeneous attrition process described by P(x, £; r,p; t) as introduced 
above in which f(x, = )dt @ (x, =)dt) is the probability of loss of one of the first (second) play- 
er's units if a total of x oppose a total of & for time dt. If the probability of simultaneous loss 
of two or more units is assumed to be negligible, the (forward) transition system is 


Si Dut ee +1, &) P(x +1, 2; ...) +o (x, € +1) P (x, € +1;...) 
~ [f (x, &) + @ (x, &)] P (x, &;...); x=0,1,...,1r, 
(1) £=0,1,...,p;3 


P (x, £5 rp; 0)= oF 8°; 


P (x, £; r,p;t) =0 forallt ifx>roré>p. 
We are concerned with the case, 


f(x, #)=ax+Be , f(0,&)=0; 


(2) 
@ (x, &)=@F +bx, (x, 0) =0. 


Assumption (2) is roughly that each x-unit has chance a of death not caused by the enemy and 
b of destroying an enemy unit while a and f have similar meanings for a £-unit. For the 
case (2) there is clearly a unique solution to (1) (cf. [4, pp. 409, 416]), but the reader should 
notice that the discontinuities in (2) cause the differential equations for x > 0= £ and = > 0=x, 
not to be special cases of the equations for x — >0. The reader can verify that the exact inte- 
gration of (1) for literal a, b,a, 8 is straightforward through, say, r-2 < x <r, p-2<&<p, but 
that it readily becomes impractical for smaller x and & (for large r and p). 

The backward (retrospective) equation [5, p. 384] corresponding to (1) and (2) is 


GP(...; t 0; ¢ 
dt 





=(ar+fp) P(...; r-1,p; t)+(ap+br) P(...; r,p -1;t), 


(3) 
- [((a+b)r+(a+8)p] P(...; r,p;t), 


where in case r= 0 or p= 0 we may preserve the formula by setting P(...; - 1, p; t) and 
P(...; r, - 1, t), respectively, equal to P(...; 0,, t) and P(...; r, 0; t). The easiest proof 
of (3) is to write P’ instead of P(x, £; r,p; t) in the right-hand member of the forward equa- 
tion (1). Then P" is trivially an analytic solution of the forward equation and, by computation, 
it satisfies the initial condition of (1). 

The backward equation is convenient because it is satisfied by any function F(t, r,p) 


= = c(x, £) P(x, 2; r,p; t); e.g., the expected value of x at time t, given by c(x, =) =x, 
x,é 
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satisfies (3) and therefore can be computed by recursion on r and p without reference to indi- 
vidual values of P. The backward equation is solvable in a special case which unfortunately is 
not very important; however, the solution and argument leading to it give an indication of the 
difficulties of the general case. 

Consider first the time-free probability F(x, =; r,@) that there is some time t 2 0 at 
which the numbers of survivors are exactly x, &. Of course, F(r,p; r,p) = 1; and F satisfies 
the dual recursion relations 


a(x+1)+Bé a(é+1) + bx 


(aby Gav) + (oaBye Fh 85 1) + Gaaya e (aap) ad) PO EAE FP) 








(4) F (x, &; r,; p)= 


ar+Bp ap+br 
(5) F (x, E35 r, p) = F (x, Es r-1, p) 


(a+b) r + (@+8)p (a+b) r + (a+8)p F(x, £; r,p-1). 








One can derive (4) and (5) from previous formulas, but the reader might as well regard (5) as 
a definition. Adding F(x, =; x,&)=1 and F(x, £; r,p)=0 if x> r or & > p, one has a com- 
plete definition of F. It is the correct definition only if x > 0 and = > 0; hence our following 
argument applies only to this case. 

Supposing that a + b = @+8, one can solve (3) with the initial conditions of (1), obtaining 


(6) P(x, £; r, P; t) = F(x, £; r, p) (era -X-& ,- (atb) (r+p)t | 


Given the formula (6), one easily verifies it; we omit the computation. We were led to (6) by 
argument patterned after C. A. Truesdell [13] as follows. Replace P with the function 
e (atb)t 


Q= e (a+b) (r +p)t, replace t with the variable z= —>>p 


. Now, Q and z are so constructed 
that (3) transforms into the simple pattern equation 


(7) dQ (x, =; r, p; z) 


= =(ar+Bp) Q(...; r-1,p; z) + (br+@p) Q(...; r,p-1; z), 





eliminating the undifferenced term on the right side of the equality. In Truesdell's one- 
dimensional problem this can always be done; he gives explicit rules. In our problem it is 
this step which requires the hypothesis a + b= ®+ 8. (While we obviously cannot prove that 
the problem is "harder" otherwise, we have a more complicated, quite different, derivation of 
(6) which requires the same special hypothesis. ) 

Now, by iterating (7), the derivatives of Q(x, =; r, P; z) are expressed in terms of 
certain functional values Q(x, =; r', P', z), where r' and p’ are smaller than r and p. If the 
unknown function Q is analytic in z, then it can be written as a Taylor series. Expanding 
about the value of z which corresponds to t = 0, we find from the initial conditions that all 
terms of the series vanish except the (r+p -x-£)-th. Hence Q is known in terms of z, and 
therefore P is known in terms of t. 


The iteration mentioned at the beginning of the preceding paragraph leads to complicated 
coefficients. One can in principle keep track of the coefficients, $(x, =; r,), which turn out to 


be P(x, £; r,p) (xe )as in (6). We found it easier to observe that if x' + #' =x+ 4, then (since 
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a+b=a +8) the ratio of P(x’, = 
the same as the ratio of the corresponding ¢'s or F's. Hence, it suffices to find 


; r,P; z) to P(x, 4; r,P, z) is independent of time and is 


z= 
x+eak OM &5 


r, Pp) = G(k; r,p). (The corresponding sum of F's is unity since the total number of survivors 
is k once.) Now the probability that the number was k at time t and diminished before t + dt, 
may be written 


(a + b)k (e (a+b)t . 1) T+P +k, - (a+b) (r+p)t G(k; r,p) dt ; 


the integral of this expression from t = 0 to infinity is unity (interpreted as a probability), and 
by calculation this is G(k; r, p)/(*P). Hence we obtain (6). 

Numerically, the attrition process (1) and (2) can be solved by recursion on a digital 
computer with standard techniques. One fixes a, b, a, 8 to a factor of proportionality and then 
tabulates the P's for desired values of t. Such tabulated probability distributions seem to be 
what is required for the games to be presented in Sections II.1 and II. 2. 

One criticism of (2) as a description of attrition rates (in addition to its apparent dif- 
ficulty of analysis) concerns firepower: the firepower of each unit contributes to the chance of 
destruction of each enemy unit. We remark first that for solution on a computer it is practical 
to have f and ¢ non-linear; consideration of particular alternates to (2) is left to the reader 
who has a special physical situation to approximate. What does seem to be to the point is the 
obvious answer that we do not wish to rule out the consideration of a battle as a collection of 
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independent events: each event or engagement can be described by a system such as (1). 
Suppose that the physical situation dictated that never more than two units would fire on 
the same enemy unit (cf. [12]). An engagement would then have (r, P) equal to one of (2, 1), 
(1, 2), (1, 1), (1, 0) or (0, 1) cases for which (1) is easy to solve. For any (r, P), one requires : 
that the player with numerical superiority can arrange the (unique) most favorable (to him) set Ss 
of engagements. Then the probabilities P for the battle (r, 0) are computed by recursion: for 
any (r, P) there is a "nearest" (r', p'), r' < r,p'< p such that the battle (r, p) consists of the 
battle (r', p') plus one additional engagement. The average number of survivors from the battle 
is of course the sum of the average survivors from engagements; the probability of winning 4 
(destroying all enemies) is a simple product; other such expressions are readily computed. 


2. A TRUNCATED PROCESS 

In this section we remove the continuous variable t in favor of the discrete x + £, the 
total number of units surviving. The discrete steps in the battle correspond to the successive 
losses of individual units. As before, we rule out simultaneous destruction of two or more units 3 
and start with (1.1,2). This time we suppose r= x and p = = and specify that at most one unit . 
is lost. We obtain 


+ ee ps me 
PRS) Tikes Sls: 


P(x, £;...) = exp {- [(atb)x + (@+8)2]t}, 





—_— ae 2a 


J ax+Bé 
~ (a+b)x + (@+8) = 





(1) P(x - 1, =;...) i- PG, €;..<3), 


~ 
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From (1) we find easily 


lim » ‘y ax+Beé 
to OG - »83..-)* Cobia s tatpye 





=P (x, &), 


(2) 
lim P + 
t—so P(x, &£-1;...)=1-P (x,&)=P (x,é). 


We label these probabilities P* for the favorable event from the first players point of view and 
P” for the unfavorable. For any x, £, r,p,t in the process (1.1, 2), P* is the probability that, 
given x and £ survive at t, the next unit lost will be a £-unit. 

We imagine that this time-free process starts with r vs. Pp and is continued until one 
force is annihilated. If the end results (x, 0), (0, £) are evaluated by a function u, the values of 
u can be computed recursively by the formula 


(3) u(x, £) =P” (x, =) u(x - 1, £) + P* (x, &) u(x, & - 1); 
s 

i.e., the value at (x, £) is this convex combination of the values at the possible successors of 
(x, =). For example, if v(x, 0)= 1 for x > 0, v(o, =) = 0 (v(0, 0) need not be defined), then v 
is the probability that the first player will win. Again, if v(x, 0) = x, v(0,#)=0, v computed 
by (3) is the unconditional number of x-survivors from a fight to the finish combat. 

It should be clear that the truncated process of this section can be used if one assumes 
new strategic decisions can be made whenever a.unit is destroyed. That is, the application is 
not solely to fights to the finish; we develop this in I1.3. 


3. DETERMINISTIC PROCESSES 

In this section we are concerned with the average progress of a battle: we ask for 
x'= x(t) and £' = £(t) such that P(x’, £'; r, p, t) = 1. 

The classical Lanchester equations [9, Chapter 5], in case there is no replacement of 
losses, are 


dx 

ae @ +88 <-f£, 

dt B 
(1) = -@F -bx, 


x(O)=r, E(O)=p. ! 


The solutions to equations (1) are given in [9, p. 72]. If a= a@ = 0, the flow lines are hyperbolas 
with asymptotes given by x“b= &°8. Thus one speaks of the Law of n’: the effectiveness of a 
force is measured by multiplying its firepower by the square of its size. In any case, there is 
one straight flow line (in positive x and =), given by 


(2) _@-a+Y(a-a)*+ 4b6 


2B 
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If bB > aa, the other flow lines bend away from the line (2) with increasing t; thus an initial 
advantage is increased as the fight continues. If aa > b§, the flow lines bend toward (2). If 
aa = bf, the flow lines are straight lines parallel to (2). In some degenerate cases one player 
always wins, but in general there is a critical ratio, given by the slope of (2) such that the win- 
ner can be determined by evaluating each x-unit at this price in terms of £-units; the winner 
is the force of greater value. We have cited the Law of n°” above for the case a= a = 0, simi- 


lar descriptions of the combat for other cases are easy. We return to the problem of estimating 4 


intrinsic values of units in Part IV. 

It is of interest to compare (1) with equations satisfied by the average number of survi- 
vors in (1.1, 2). Upon multiplication by x and summing and similarly for £, these latter equa- 
tions yield (cf. [11, p. 24]): 


- aX -BF +62 EP(0,2;...), 


- a? - bx +b 2xP(x, 0;...), 
x 


x(0)=r; 2 (0)=p. 


Direct calculation with (3) is impossible unless the summation terms are known. In view of our 
I.1 this would seem to indicate that X and # could then be computed from their definition. We 
observed above that X and £ satisfy the backward equation (1.3) so that such a recursive cal- 
culation appears to be indicated for values t such that (1) is an inadequate approximation to (3). 

In summary, the deterministic processes which we have noted are: the Lanchester 
equations (1), the exact equations (3), the readily solved expressions for average survivors 
noted in the last paragraph of section I.1 and equations (2.3) for survivors in the truncated 
process. 


4. NON-HOMOGENEOUS ATTRITION 

In [11, p. 22], equations generalizing (1.1) are given for combat of a force of m unit 
types of strength ri in the i-th type for i= 1, 2,...,m against a force similarly described 
by Pyr +++» Pye We shall not write these equations since our primary interest in probabilistic 
non-homogeneous attrition is a generalization of the truncated process of Section 1.2. As the 
analogue of (1.2) we assume for r; respectively p; non-zero: 


f; (Pyye es Sa. % Pyy-++y PA)= a,r,+ = PyByi Mir 


(1) 
9; (Ty,--+5 fo 3 Pyy-++9 Py) = 5p; + ; Tbs jPiy3 


e.g., the probability of loss of one unit of type i in combat of time dt is fi - dt if ri + 0 and 
is zero if r,= 0. 


As usual, we have introduced variables in Latin-Greek pairs and it will suffice to explain | 


one from each pair. Here a represents a rate of exponential decay of i-type friendly forces 
and db; j is a measure of effectiveness of fire of i-type friendly units against j-type enemies. 


As a new concept (and one to be exploited in Part III), we have introduced the strategic variables 3 


P; ;’ the proportional part of the total effort of units of type i (for player I) which is directed 
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against units of type j. Here we are using strategic in a game theoretic sense; in military 
language the p; js are tactical variables. 

We restrict ourselves to a study of the optimal choice of the p's and 7's in Part III 
wherein (cf. (2.1)) it suffices to look only as far as the first casualty. If the symbol qd; refers 
to the possible event that the first unit killed is a friendly unit of type i, we require P r(d;) 
and the analogous probability P r(6;). As in (2.2) we obtain 


283.1; 


%*; “4 Pi ji ji 





(2) Pr(d,) = 
vo cart a; py + = (Ty, Dy 5 Pj + PB iT i) , 
k j j,k 
4 
Finally, for the sake of completeness, we remark that the corresponding generalization 


of the deterministic equations (3.1) is as follows for i=1,..., m respectively j=1,...,n: 


dx; 
ar 7 7AM - + Xp 5 Eqsee-s En) x, (0)=r;, 
(3) 

des 

ar 7 Oj %y-+ +s Xm i Eqreees é,) , & (0) =p; ° 


For fixed p's and 1's, these equations are treated in[11, pp. 12-17]. Their solution is natu- 
rally much more complicated than the solution of the Lanchester equations; however, as we 
have remarked, our interest is in the selection of the p's and 7' s in the probabilistic case for 
which (4.2) suffices. 


PART II - HOTSPOT PROBLEMS 


We begin with a summary of C. Tompkins' paper on Hotspot games. These games are 
probabilistic in that they are based on attrition such as described in Section I.1; their calcu- 
lation presents several difficulties. In Section II.2 we present a related matrix game (for which 
there are several efficient known methods of solution). There is a heuristic connection between 
these matrix games and Hotspot games but, more importantly, whenever one has a solution in 
pure strategies then so does the other, with the same good strategies and value. Finally, in 
Section II.3 we introduce a simplified game inspired by the Hotspot model. Instead of having 
new assignments of forces to battle at stated intervals, we permit a new assignment for both 
players whenever a unit on either side is destroyed. This simplified game has a solution in 
pure strategies; hence neither player would wish to change his assignment at any other time 
than those prescribed. The best strategy for either player in any case is to assign all, none, 
or exactly one of his units to combat. The games of Section II.3 are thus disposed of; they are 
used in Parts III and IV as a basis for generalizations toward more difficult problems. 


1. THE HOTSPOT GAME 

In this section we summarize [12] in which C. Tompkins introduced a zero-sum two- 
person game concerning assignment of forces to a disputed area, ''Hotspot."" The game is not 
a matrix game; however, it is reducible to a one-move game. 
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For the k-th move, (Ty P,) units from total resources (m,, Hy) are assigned from safe D 
havens to the Hotspot area. The result of a move is possible loss of units by one or both play- r 
ers; it is supposed that a homogeneous attrition function P(x, 2; r, p, t') of Part I applies where 
t' is constant and does not vary between moves. No units can be introduced after play has 
started. The game terminates at move k if Ty * Py = 0, in which case payoff to Player I for n 
Hotspot is the quantity F, -®, or 0 according as Ty + 0, Py + 0, or Ty =P, = 0, respectively. (4 
In addition, there is the payoff -(m, ~ m,,) +0(Ly - My), i.e., Player I pays 1 for each of his 
units lost and receives o for each of Player II's units destroyed. Thus, we adopt the usual 2. 
convention that Player I is the maximizing player. : 

Tompkins proved that the game can be considered to terminate in a finite number of ‘ al 
moves and thus established the existence of a unique value, v(m, 4), to the many-move game E T 
[10]. In order to provide for more efficient calculation than the constructive method of his % gi 
existence proof, the next step was to reduce the game to a single move. Since v(m,y) does : 
exist uniquely, one can write the following expectations of Player I for the first move where 
(r, p) are assigned to Hotspot from total resources (m, #4) and each player plays optimally zp (1 
thereafter: co 
(1) E(r,p; m,n) = A(m, w; ¥, p) + (B(r, p) + 1) v(m, wu). BA 

ate 
Here, A is the expectation from all possible outcomes of the move which result in loss of at PS . * 
least one unit; or precisely, f « 
S (r 
A(0, 0; m, #) =0 oe 
A(r, 0; m, ») = F - > (r - x) P(x, 0; r, 0;t'), r +0; en 
x 
(2) : 
A (0, p; m, a= -O+eZ@- £) (P(0, £;0,p,t), p+0; 
A(r, p;m, u)=  [v(m-r+x, w-p+*) - (r-x) +0(p-2)]- P(x, & ry pst'), 140,940. 
x,é 
where the summation extends over 0 < x <r, 0< £ <— less the point (r, p). For manipulative 
convenience, In 
an 
B(r,p)= P(r,p;1r,p;t')-1, r-p 40; ie 
(3) int 
=-1, otherwise. . G, 
It should be noted first that A is independent of m and p for r ‘ p=0. Indeed, for these cases Re 
A = E, so that games where one or both players have no resources can be disposed of immedi- one 
ately. Suppose next that an inductive hypothesis is made: v(r,/P) is known for r <m and p<u rey 
with the sole exception of v = v(m, #). Then, all quantities in (2) and (3) are known and a 
straightforward procedure would be to define v to be the value of the game with payoffs (1), or 
equivalently, the root of 
(4) w(v) = Value (A + Bv)=0. 
By 


Tompkins established the validity of this definition and gave an iterative method of calculating v. 
The existence of a unique root in (4) has also been proved by von Neumann [14], Loomis [8], and 
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the P's, we are again led to a matrix game with payoffs A(r, P; m, )/-B(r, p) . 
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Dines [3] under the hypothesis that the elements of the matrix B are negative. For further 
related results, see Bellman [1]. 

The Hotspot game is thus reduced to a one-move game whose calculation is somewhat 
different from standard matrix games: its value and optimal strategies result from making the 
matrix game in (4) have zero value. In order to find v(m, u), (m+1) (u +1) successive systems 
(4) must be solved. 


2. A HOTSPOT VARIANT 

As we have just seen, solving the original Hotspot game means determining a number v 
and optimal strategies such that the game G, with payoff matrix (aj; + dij v) has value zero. 
There is a solution in pure strategies (i, j) if, and only if, v = -a;;/d;; , which suggests the 
game G, with payoff matrix (a; ;/-b;,)- In fact, 


If each dij < 0, G, has a solution in pure 
(1) strategies (r,s) and v= &,_/-%,. if, and 


only if, (r, s) is a solution of Go . 


aw. 


PROOF: If G, has such a solution, say v*, the remaining payoff elements, aij+ dij 


in row r (column s) will be non-negative (non-positive). Since the slope of the line E = ai; 


] 
+ bi¥ is negative, the v-intercepts satisfy ag/Yrs = Min a,j/-b,; = Max ai,/-bi, «ah. 


(r, s) is a solution of Gp. The argument is clearly reversible to obtain the converse. 
The following example shows that neither the game values nor even the pure strategies 
entering mixed strategy solutions need agree. 


5 1 1 3 

A=| 1 4-e] , -B=| 5 2-€ 
1 
1 1 3 5 


In G,, v= 1 and Player II plays rows one and two. On the other hand, for small €, value (Go) >1 
and rows one and three are played. We have examples where the game values do not agree 
under mixed strategy solution for A and B given by (1.2, 3). We have not been able to find 
interesting restrictive classes of A's and B's permitting comparison of strategies for G, and 
G, which enter into optimal mixed strategy solutions. 

We conclude this section with a formal connection between the games G, and Go. 
Returning to Section II.1, proceed as before through equations (1.3). Then assume that at least 
One unit will be lost in every move with r-P + 0 and, furthermore, P(x, *; r, p; t') is to be 
replaced by Q(x, =; r, P; t’); 


Q(r, P; T, Pp; t') =0 


P(x, ©; r, p; t’) 
1 - P(r,-p; r, p; t’) 





Q(x, &; r, p; t') = 





By this process of discounting the chance that there will be no units lost and then renormalizing 
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Unless each v(m, #2) is determined by a game with saddle point, this new procedure 
may lead to different v's so that the A's which have just been written may not coincide with 
those for the original Hotspot game. It is not clear how close the connection between these 
two procedures actually is. Numerical experience has indicated that the connection may be 
stronger than is indicated by (2.1). 


3. A SIMPLIFIED GAME 

The game of this section is based upon the truncated attrition process of Section I. 2. 
Two commanders, disposing respectively of r,p units, dispute the possession of an objective. 
If they assign x respectively = units (retaining reserves r-x,/P - £), and if x-¢ > 0, there 
ensues an attrition process governed by (1.2.1). If x-& = 0 the battle is over and any non-zero 
force on the battlefield has gained the objective. Whenever a unit on either side is lost, both 
commanders are free to make new assignments of their remaining forces. 

One has a game as soon as values of the terminal states are specified. For each r and 
P, one has a game with an (r+1) by (9 +1) matrix as soon as five values are known: v (r, p), 
the value to the first player if the other assigns no force, so that the first player wins the objec- 
tive; v (r, p), the value of the opposite situation; v(r,p), the value if both players give up the 
fight; and the game values w(r-1, Pp), w(r, p-1). There are numerous inequalities one would 
expect the v's to satisfy. Specifically, we assume v < v < af 

The payoff to the strategies (x, =) in the game (r, p) is (I.2.2): 


(1) H (x, ; r, p) = P* (x, 2) W(r, p-1) + P” (x, £) W(r-1, p). 


The formula (1) naturally applies only for x- £ +0. One has also H(x, 0; r, 0) = v* (r, 0) and 
the symmetric formula for (0, p); the case r= p= 0 need not be considered as it cannot arise 


from any other case. 

The (r+1) by (9+1) matrix H always has a saddle point. The main reason is that 
P* (x+1, £) 2 P* (x, =) 2 P* (x, +1) if, and only if, b8 > aa and all these inequalities reverse 
together. Then, if b§ > aa, the strategy r (and P) dominates all others, except possibly 0, 
and we reduce immediately to the matrix 


v* (r, p) v" (r, p) 


(2) 
v (r, p) v(r, p) 


where v*(r, ) =H(r, p). But v < v <v*; hence the question is where v* lies. 
For the case bf > aa, 


if v* >v*, v* is a saddle point of (2); 


+ 


if v <v*<vt, v* isa saddle point; 


if v*<v, v isa saddle point. 
Similarly, 


if bB < aa, substitute v* = H(1, 1) for v* in 
(3); the result is true. 


(3') 





th 
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The conclusion (3') rests essentially on the special assumption H(x, 0) = constant for 
x > 0, H(0, £) = constant for £ > 0. But (3) would hold on the reasonable weaker hypothesis 
H(x, 0) monotone in x, H(0, £) anti-monotone. The degeneration of these games confirms the 
qualitative observation that one should usually commit all available force to action (no other, 
simultaneous action being in view); for usually bB 2 aa. (From (3) and (3'), if bB = aa, then 
all non-zero assignments are equivalent.) 

The entire course of a fight governed by (3) is simply as follows: both forces are 
entirely committed and continue fighting until one gives up the fight (possibly being annihilated). 
Under (3'), on the other hand, each force sends in one unit; when the "champion" of a force is 
lost, it is replaced, until finally one force abandons the field. Then any modification such as 
cost of moving or advantage of temporary possession of the field will incline to make the famil- 
iar principle given by (3) even more generally applicable. 


PART Il. PROGRAMMING GAMES 


In this part we deal with a model involving the isolated strategic problem of distribution 
of fire over enemy targets of several types. The attrition is described by functions introduced 
in Part I and the model of the game has a design closely similar to the last model considered 
in Part II. It turns out that the present model can be solved by comparatively simple compu- 
tation, for interesting mathematical reasons which we set forth in some detail. We conclude 
with an examination of "extensive programming games," finding that combination of decisions 
on assignment of force with decisions on distribution of fire presents serious difficulties, which 
we do not overcome. 


1, FIRE PROGRAMMING GAMES 
Formally, a fire programming game is described by a payoff function 


(1) H(P, 1)= 2 Pr(d.) w(d,) + 2 Pr(5,) w(6,). 
i i vj j j 


The strategic variables, P, Il, represent distributions of the fire of several weapons over 

several enemy targets. In (1) we have suppressed explicit reference to the forces engaged in 
the game. There are m types of units engaged with n types of enemy units; there are ri 
friendly units of the i-th type (i= 1, 2,..., m) and P; units of the j-th enemy type. Then P 


is an mXn matrix of real numbers Pij subject to the constraints 


Pij 20 for all i, j; 
(2) 


7 Pi 1 for each i. 


We interpret Pj; as that fraction of the total firepower of the i-type friendly units which 
is directed at enemies of type j. Similarly the enemy has a firing strategy II = (7 i)» subject to 
corresponding constraints. Now H is the value of the situation to our side; thus P is chosen to 
maximize H(P, I), and I to minimize it. 

The symbol qd; refers to the possible event that the first unit killed is a friendly unit of 
type i. We suppose that the resulting situation has been evaluated already, and has value w (d;). 
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Unless each v(m, #) is determined by a game with saddle point, this new procedure 
may lead to different v's so that the A's which have just been written may not coincide with 
those for the original Hotspot game. It is not clear how close the connection between these 
two procedures actually is. Numerical experience has indicated that the connection may be 
stronger than is indicated by (2.1). 


3. A SIMPLIFIED GAME 

The game of this section is based upon the truncated attrition process of Section I. 2. 
Two commanders, disposing respectively of r,p units, dispute the possession of an objective. 
If they assign x respectively = units (retaining reserves r-x,p - £), and if x-¢ > 0, there 
ensues an attrition process governed by (1.2.1). If x-& = 0 the battle is over and any non-zero 
force on the battlefield has gained the objective. Whenever a unit on either side is lost, both 
commanders are free to make new assignments of their remaining forces. 

One has a game as soon as values of the terminal states are specified. For each r and 
P, one has a game with an (r+1) by (9 +1) matrix as soon as five values are known: v (r, p), 
the value to the first player if the other assigns no force, so that the first player wins the objec- 
tive; v (r, p), the value of the opposite situation; v(r,p), the value if both players give up the 
fight; and the game values w(r-1, Pp), w(r, p-1). There are numerous inequalities one would 
expect the v's to satisfy. Specifically, we assume v < v < v’. 

The payoff to the strategies (x, =) in the game (r, p) is (1.2.2): 


(1) H (x, EY, p)= pr (x, £) W(r, p-1)+ (x, £)W(r-1, p) ° 


The formula (1) naturally applies only for x- = +0. One has also H(x, 0; r, 0) = v~ (r, 0) and 
the symmetric formula for (0, p); the case r= p= 0 need not be considered as it cannot arise 
from any other case. 

The (r+1) by (@+1) matrix H always has a saddle point. The main reason is that 
P* (x+1, £) 2 P* (x, =) 2 P* (x, £ +1) if, and only if, b8 > aa and all these inequalities reverse 
together. Then, if b§ > aa, the strategy r (and) dominates all others, except possibly 0, 
and we reduce immediately to the matrix 


v* (r, p) v (r, p) 
(2) “ 
v (r, p) v(r, p) 


where v*(r, ?) =H(r, p). But v < v <v*; hence the question is where v* lies. 
For the case bf > aa, 
if v* > v*, v* is a saddle point of (2); 
if v <v* <v*, v* isa saddle point; 


if v*<v , v isa saddle point. 
Similarly, 


if bB < aa, substitute v* = H(1, 1) for v* in 
(3); the result is true. 


(3') 
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The conclusion (3') rests essentially on the special assumption H(x, 0) = constant for 
x > 0, H(0, £) = constant for & > 0. But (3) would hold on the reasonable weaker hypothesis 
H(x, 0) monotone in x, H(0, <) anti-monotone. The degeneration of these games confirms the 
qualitative observation that one should usually commit all available force to action (no other, 
simultaneous action being in view); for usually bB 2 aa. (From (3) and (3'), if bB = aa, then 
all non-zero assignments are equivalent. ) 

The entire course of a fight governed by (3) is simply as follows: both forces are 
entirely committed and continue fighting until one gives up the fight (possibly being annihilated). 
Under (3'), on the other hand, each force sends in one unit; when the "champion" of a force is 
lost, it is replaced, until finally one force abandons the field. Then any modification such as 
cost of moving or advantage of temporary possession of the field will incline to make the famil- 
iar principle given by (3) even more generally applicable. 


PART Ill. PROGRAMMING GAMES 


In this part we deal with a model involving the isolated strategic problem of distribution 
of fire over enemy targets of several types. The attrition is described by functions introduced 
in Part I and the model of the game has a design closely similar to the last model considered 
in Part II. It turns out that the present model can be solved by comparatively simple compu- 
tation, for interesting mathematical reasons which we set forth in some detail. We conclude 
with an examination of "extensive programming games," finding that combination of decisions 
on assignment of force with decisions on distribution of fire presents serious difficulties, which 
we do not overcome. 


1, FIRE PROGRAMMING GAMES 
Formally, a fire programming game is described by a payoff function 


(1) H(P, 11) = ¥ Pr(dj) w(d) + 2 Pr(6) w(d). 


The strategic variables, P, Il, represent distributions of the fire of several weapons over 

several enemy targets. In (1) we have suppressed explicit reference to the forces engaged in 
the game. There are m types of units engaged with n types of enemy units; there are rj 
friendly units of the i-th type (i= 1, 2,..., m) and Pj units of the j-th enemy type. Then P 


is an mXn matrix of real numbers Pij subject to the constraints 


Pij 20 for all i, j; 
(2) 


Zp..=1 for each i. 
= 


We interpret Pij as that fraction of the total firepower of the i-type friendly units which 
is directed at enemies of type j. Similarly the enemy has a firing strategy II = (7, i)» subject to 
corresponding constraints. Now H is the value of the situation to our side; thus P is chosen to 
maximize H(P, I), and I to minimize it. 

The symbol qd; refers to the possible event that the first unit killed is a friendly unit of 
type i. We suppose that the resulting situation has been evaluated already, and has value w (d;). 
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Thus we implicitly suppose (a) that we have listed all possible developments and, in particular, 
forces will not be added to nor subtracted from the battle before a kill occurs, and further (b) 
that a kill will be recognized immediately by both commanders, or at least that the value of the 
result does not depend on the strategies P and ‘ (as it would if there were a time lag in chang- 
ing strategies). Note that we had corresponding assumptions in Section I1.3; (a) was supported 
by the result, but the argument for (b) is merely simplicity. 

Interchanging Greek and Latin (excepting the subscripts) turns d; into 5., the corre- 
sponding event that the first kill is a j-type enemy. The probabilities Pr(d;) depend on P 
and II by the formula (1.4.2) which we relabel 


ajrj+ ¥ iP iM 


eT Tt i Peg Ply * OFF Mite 





(3) Pr (d;) = 


With (1), the Greek- Latin pair (2), and the Greek-Latin pair (3), we have completed the 
definition of a fire programming game. The assumed manner of attrition, described extensively 
by the coefficients (1.4.1), is essentially the simplest form which has any pretensions of describ- 
ing actual combat. The move rule of the game is also the simplest available; formally, we have 
only one move, but in effect, we assume that a move, i.e., a change of firing strategy, can be 
made instantaneously as soon as there is any reason to move. Finally, we have limited the 
commanders to making decisions on one aspect of tactics, namely the apportionment of fire 
among targets. 

Solution of the present problem turns out to be remarkably easy, for reasons which can- 
not be expected to apply when any of our simplifying assumptions are removed nor even if the 
model is set up a little differently without being more intrinsically complex. Hence we wish to 
emphasize at this point that the problem we are faced with is the determination of optimal strat- 
egies P and II varying with time and with the observed strategy of the opponent. Such problems 
are quite difficult; but in this model we shall find optimal constant strategies. 


2. COMPUTATION METHODS 

Before solving a fire programming game we shall consider the simpler problem of 
linear fractional programming, the maximization of a linear fractional function under linear 
constraints. One is given a convex polyhedron X in real n-space, and a function 





t-x+h_ 
u-x+k’ 


(1) f(x) = 


one must find max f(x). Now for linear functions f, numerous effective methods are known; 
xeX 
this is the problem of linear programming. We shall describe a method for linear fractional 


programming which involves solution of linear programming problems. First, however, we 
shall describe the problem in geometric language. 

The simplicity of (1) lies in the fact that it is essentially a two-dimension transforma- 
tion, in the following sense. The denominator vanishes on some hyperplane D, and the numer- 
ator vanishes on some hyperplane N. Usually (Case I) D and N are not parallel, but meet in 
an (n-2)-dimensional subspace L of the given n-dimensional space E. The function f is 
undefined on L; it is constant on each subspace parallel to L. Thus we may as well project E 
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along L upon a plane, in which D and N become lines meeting in a point L. The function f is 
constant on lines passing through L; on any circle around L, f goes through all real values 
monotonically, twice, jumping from +o to -o each time one crosses D. Thus we may clarify 
our description as follows: f is a one-dimensional transformation, having singularities which 
appear both as infinities (on D) and as essential singularities (on L), but we can apply first a 
two-dimensional transformation with no singularities. All the complications appear in the 
plane, and even there the situation is rather simple; the reader familiar with homogeneous 
coordinates for the projective line will recognize them here. 

Turning to the polyhedron X, transformed to a polygon by the above projection, we see 
that it cannot meet D if a maximum is to exist. Thus it must lie on one side of D. Here f 
increases monotonically as x moves in a direction which we may call clockwise; we wish to 
find the farthest ray through L, going clockwise, which touches X. For such to exist, one must 
have further conditions on X, which we omit to specify precisely; it suffices if X is bounded. 

Let us write the problem 


9 max t-x+h_ 
(2) xeX u-xtk 


The denominator has constant sign, which we may take positive. Then multiplying out preserves 
inequalities, and we have 


(3) max (t-vu).x= vk-h. 
xeX 


That is, the ray f(x) = v, which is the farthest clockwise in X, is also the farthest in the family 
of all lines parallel to it, which still touches X. Unfortunately we do not know this parallel 
family to begin with. However, we can approximate it. The method is 


max t-x+h, 


xe X u-x+k i a bounded polyhedron X, 


1 


Method: To find 


(1) Choose x” in X, and inductively 


n tx +h 
(2) Compute w = : 


se 
u-x +k 


(3) Solve max (t - w"u) -x=w'k-hed. 
xe X 


(i) In (3), d 20. If d= 0 then w"= v and x" is optimal. Otherwise 
(4) Let xnt 1 be optimal in (3) and repeat (2). 


(ii) The values w,; increase monotonically to v and the iteration terminates, i.e., wi=y 
for some n. 

The formal proof consists of a few computations. If d < 0 in (3) then w' > v, which is 
impossible by definition of w". The values w" increase monotonically because we are steadily 
approximating toward the extreme ray f(x) =v. The iteration terminates because the solution 
of each linear problem (3) is a vertex of X, and there are only finitely many of these. 
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We have omitted Case II; D and N are parallel. In this case t= au in (1) for some 
constant a, The method above applies, and w~ = v. Geometrically, there are no singularities 
in this case, and f is a projective transformation onto the projective line. The interested 
reader may verify this for himself. We shall also omit working out an analogous method for 
certain minimax problems more general than fire programming games, namely 


max min b EAS 
(4) (a,b) eX, (c,d) eX, bed, 


where (a,b) and (c,d) are points in the plane., Fire programming games have this form, where 
a, b, c and d are linear functions of several real variables which happen to be subject to the 
very convenient constraints (1.2). 


Let us write F = 2 f; and @=2 $5 From (1.4.1), (II1.1.1), and (11.1.3) we have 
1 J 


z f, (P) w(5,) +2 $; (11) w(d.) 
j aE. 3 
(5) H(P, 11) = 





F(P) + (1) 


Define the marginal values of units in terms of the true value v = max min H(P, I), by 





p 7 
Ss; = v-w(d,), a, w(6;) - v. Note that we do not yet know whether min — H(P, 1) =v or 
IT 


not. But from (5) and definitions we get 


in (= f, (P - D¢, (1) s,)=0. 
(6) ae iis & eet OO te he 


Writing H as vF(P) + a(P) + v@(T) - b(n) we see that max a(P)= max b(I) and that v isa 
F(P) +@(1) Pp ll 





true minimax value. Precisely, from (6), P is optimal if and only if it maximizes the linear 
function 2 f (P) o; (and similarly for 1). Taking account of the constraints 1.2, we have 
J 


(6') 5 @ 505%; +% ry bij3°j = 4 a.r,S;+ yj es BS; . 


and optimal fire distributions are pure distributions. Each friendly type i selects that enemy 
type j which maximizes b,;0 } and directs all its fire upon that type. 

Again the computation hinges on approximating the true value v, and consists of solving 
linear problems, one of which is "tangent" to the true problem at the solution. For any pro- 
posed value w, one solves (6') (quite rapidly; it consists of some arithmetic and choice of max- 
ima from several rows of numbers) and commonly finds inequality instead of the equality 
written in (6'). If equality holds, then w is the true value. If the left side is greater, 
then w is too small. In this case the firing strategies which solve (6') for that w, when 
substituted into H(P, Il), will yield a larger trial value, w'. If one proceeds with w’, then the 
iteration will necessarily terminate; but we have not sufficient numerical experience or under- 
standing of the computation to claim that this is the best method. After all, now that we have 
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proved that optimal pure distributions of fire exist, the examination of all pairs of pure strat- 
egies is a finite method. That proposed above, however, has the advantage of stepping mono- 
tonically to the solution. 

Let us note that one could deduce the minimax theorem for H(P, I|) from a more gen- 


eral minimax theorem for bilinear fractional functions [14]. The form 2 : 


solve by solving a succession of linear programming problems. It is the special form of the 
constraints (1.2) which trivializes these linear problems. Now, among the numerous respects 
in which our model fails to describe real combat accurately, one may note that we have admit- 
ted the possibility of forty battleships converging upon a rowboat to sink it in a fraction of a 
second. This can be corrected to some extent by imposing additional constraints. The cost is 
the introduction of linear programming problems more difficult than choosing the maximum of 
a row of numbers. 


permits us to 


3. EXTENSIVE PROGRAMMING GAMES 

One can combine fire programming problems with Hotspot assignment problems as 
treated in Part II. The assumptions above are similar to those in the third model of Part II. 

If we try to build on either of the first two models, we find new difficulties. One must decide 
when changes in fire distribution can be made. The main alternatives are (1) whenever a unit 
is lost, and (2) at the same times as the assignment changes. If we follow (1), then we must 
make a more careful analysis of the attrition process than we have yet done (and as noted in 
Part I, we are not able to handle the problem); if (2), then we face a more difficult type of fire 
programming game than that considered above. In either case, the computational problems 
appear to be beyond the present capacity of computers. 

Accordingly, we return to the move rule of Section 11.3: new assignments can be made 
precisely when a unit is lost. We shall not describe the model in detail; the commanders 
determine assignments, meet the enemy, and face a fire programming game involving the 
forces which have been assigned. The existence of a solution and the outlines of a computa- 
tional method are fairly obvious; one must begin with forces of one unit and compute backwards 
up the compound sequence of minimax problems. The construction of such composite games, 
and the existence of solutions, are worked out in a very general setting in [6]. 

Even with the model we have just selected as the easiest to handle, there are serious 
difficulties. It does not seem reasonable to use the rules we have imposed on strategic 
decisions—that they change only when a unit is killed—unless one is lucky enough to have a 
model in which the commanders could not gain by disregarding these rules. On the other hand, 
these rules may be too permissive if they lead to a battle in which hundreds of units are engaged 
and strategies are changing several times a minute. We have not been able to investigate 
whether the second objection applies to the present models. But a certain battle of four units 
Shows that the first objection does apply. 

We define the example and give the pure strategies involved in best play; the interested 
reader can reproduce the computations. The 2 x 2 firepower matrices are 


15 


(b; 5) = ; @;)= 
1 
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All a; and as vanish, The final value is 1 if the enemy is destroyed (or quits the fight), 0 
otherwise. The game values w(m,, Mo; 14, Ho), When m, units of the i-th friendly type (and 
mM j for the enemy) are available, are these: 


w(1, 0; 1, 0) = .8333 
w(1, 0; 0, 1) = .5000 
w(0, 1; 1, 0) = .0625 
w(0, 1; 0, 1) = .6667 
w(1, 0; 1, 1)=.3571 
w(0, 1; 1, 1) = .0392 
w(1, 1; 1, 0) = .8661 
w(1, 1; 0, 1) = .8750 


All available units are assigned to the battle in these eight cases. In the first four there 
is no choice of targets; in the next two the first enemy unit is the target; in the last two the first 
and second friendly unit, respectively, are the preferred targets. Note that in (1, 1; 1, 0) the 
marginal value of the first friendly unit is more than fifteen times as great as the marginal 
value of the second friendly unit. 

Coming to the case (1, 1; 1, 1), there are five non-trivial fire programming games to be 
solved. In each case, when a unit has a choice of targets, the choice is made according to the 
strategies 


1 0 
P= : 
Bug 


The game matrix, labeled with assignment strategies, the rows for the friendly force, is 


(1, 1) (0, 1) (1, 0) 


(1,1) /.5001 .6594 -5051 
(1,0) | .6362 -4527 .17357 
(0,1) \.4137 .6964 . 3895 


There is no saddle point. The minimax in pure strategies is .6362, but the maximin is .5001. 
For mixed strategies, the unique kernel is the 2 x 2 submatrix in the upper left; the value is 
.5633. 

This means that whatever assignment the commanders make, as soon as each identifies 
the opposing force, one commander will see that he could gain either by sending a unit into 
reserve or by taking one from reserve. Under these conditions stability will exist, in the 
physical situation; but to find it we must specify the conditions of the battle much more fully, 
and the solution of the problem will be correspondingly more difficult. 


PART IV. VALUE ESTIMATES 


In this part we propose estimates of intrinsic values of weapons, guided by the models 
already examined. For the case of one type of weapon against one enemy type, as described 
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above, we find two simple formulas which seem to be useful in the respective cases bf 2 aa 
and b§ < aa; the formulas coincide when b§ = aa. Each formula is most useful when the 
friendly and enemy forces are about evenly matched. Thus the general problem of estimation 
of values is quite complex, even when only single types are considered. When several types 
are to be compared, one can begin by comparing them one against one. We find values in the 
mixed problem which seem to be a reasonable generalization of the "main" case bf > aa, 
again provided the forces are about evenly matched. However, we find them only in that we 
prove existence and (except in certain boundary cases) uniqueness; an effective computational 
method remains to be found. 


1. THE HOMOGENEOUS CASE 
Recall the formula 


a-ar+ Via -a)* + 4b 


(1.3.2) p= 2B s % 





This is the equation of the one straight line which is a flow line for the Lanchester equations. 
It suggests the attribution of values to friendly and enemy units in the ratio 


@-at Yio - a)? + 4bp /28 ; 


Let v and w be values in this ratio. Then we can say, in a Lanchester attrition process, that 
if rv > pw then the friendly force wins, in the reverse case the enemy force wins, and in the 
case of equality the battle is a draw. The margin of victory depends non-linearly on the forces, 
according to a (generalized) Law of n’; and thus the assignment of linear homogeneous values 
to units cannot be a completely satisfactory description. However, one is interested in esti- 
mating values according to simple formulas, for obvious reasons of economy; and the above 
formula seems convincing for the Lanchester model. 

The formula (I.3.2) arises from solving the equation r/p =r/p — a"'stability" con- 
dition. Let us notice that the same ratio arises from the equations 


AV=bw-av >; 
(1) 


Aw=6Bv- aw. 


In (1) we demand that the value v of a friendly unit be proportional to the net damage this unit 
inflicts upon the enemy; in time dt it destroys enemy units worth bw dt, but also destroys 
parts of itself worth av dt. It turns out also that A >.0 if, and only if, b8 > aa. In fact, if 

b8 < aq@ then the marginal value of a unit added to the battle is negative (if we assume that this 
unit could be kept in reserve, but thrown into the battle when needed). One can easily work this 
out with Lanchester equations; but, as must be clear, we wish to propose the use of (1) and 
(1.3.2) in other models and particularly in the model of Section 11.3. 

If bB 2 aa, then we know optimal strategies in Section I1.3; the strategies consist of 
putting all available units into the battle, and it is worth emphasizing that limitations on move- 
ment of units, which would complicate the other case, leave this case unaffected. Using optimal 
Strategies, we have a completely defined stochastic process. This process has been investigated 
by Richard Brown [2]; and it follows easily from Brown's results that, using v and w as given 
by (1): 
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THEOREM 1 (Brown): Asymptotically as r and p increase, if rv > (1+€)pw for 
some € > 0, then the friendly force wins with probability 1; in the opposite case, the enemy 
wins with probability 1. 

Brown has among other results a closer study of asymptotic behavior near the critical 
ratio, but it does not seem that we have a good enough approximation to reality to justify much 
concern over this matter. More to the point is the question whether for small forces the crit- 
ical ratio accurately describes the advantage; if rv > pw, is the probability of winning greater 
than the probability of losing? Not always; however, several hundred values have been com- 
puted, and the description appears to be rather highly accurate. 

Brown's results may apply as well when b§ < aa; but our investigations have shown 
that if commanders have some freedom to move units to and from a safe reserve, then Brown's 
stochastic process should not occur. What should occur, in the ideal case of IL.3, is a sequence 
of duels between single units of each force. Now David Blackwell has pointed out that this is a 
sequence of independent events with identical probability distributions; and from the strong law 
of large numbers [5, p. 208], one easily deduces the same theorem, except that the critical ratio 


is different. The ratio is still determined by r/p = r/p, and turns out to be (a +b)/(a+ 8). 
Summarizing, ‘ 


Definition: If bB > aa, the values v of one friendly unit and w of one-enemy unit are in 


2 
a-a a-a)"+ 4b 
the ratio v/w = - # if bB < aa, then v/w=a+b/a+p. 








THEOREM 2 (Blackwell): For a sequence of duels, asymptotically as r and p 
increase, if rv > (1 +€)pw for some ¢ > 0, then the friendly force wins with probability 1; 
in the opposite case, the enemy wins with probability 1. 

We can deduce from the theorems of Brown and Blackwell and the fact, proved in Sec- 
tion II.3, that when b8= aa all non-zero assignments are equivalent, the two formulas must 
coincide in this case. In fact one easily sees that both reduce to v/w =b/a. 

For small forces in Blackwell's case, we know of no extensive computations; it appears 
that the formula ought to determine the probable winner, at least as accurately as Brown's 
formula in Brown's case. 

The formulas in both cases are found by solving r/p=r/p. We cannot generalize this 
to m types of weapons vs. n types (to obtain values; actually one can obtain critical lines, but 
we want a critical hypersurface). We can and shall generalize the equations (1), which also 
give the correct formula in Brown's case. The arguments for the generalization are somewhat 
tenuous, and we cannot even describe its range of approximate validity. We have no asymptotic 
theorems for non-homogeneous forces, nor do we have a full description of flow lines for gen- 
eralized Lanchester equations. Thus the main support for the generalization is the superficial 
plausibility of (1). 

Let us notice three criticisms applicable to our arguments above. Each, with our 
answer, can easily be reformulated for non-homogeneous forces. 

The value of a unit in a battle is conceptually divisible into two parts; there is the 
immediate value of its firepower, applied to the destruction of enemies, and there is a survival 
value, equally relevant in our models whether the unit is in battle or in reserve. When aa> bf 
there is a facile distinction between these values; the "immediate" value is negative, and extra 
units should be held in reserve. The equations (1) seem to measure only this part of the value. 
On the other hand, when aa@ > bf and we permit the battle to be fought as a sequence of duels, 
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a+ 


b 
it seems that the "immediate" value vanishes and the formula ‘a+B measures the "survival" 


value correctly. This argument suggests that further analysis should reveal other consider- 
ations which bear on evaluation in the case b8 > aa — the main case, and the very case which 
we wish to generalize. The authors do not know what to do about this. 

Second, notice that, although we are working without reference to the precise final con- 
ditions, i.e., the values of the states in which the battle may end, there is a quite general (if 
vague) property which these final conditions must have. There must be a substantial value 
attached to winning the field; otherwise the inferior force would simply refuse battle. This 
means that marginal values of units are greatest when the forces are about evenly matched, 
since, for example, the accession of one friendly unit in this case means a substantial increase 
in the probability of ultimate victory. In contrast, adding one unit to an inferior force merely 
decreases the expected size of the victorious enemy force and increases the probability of 
victory, perhaps from .001 to .002. (We pause to note: (1) the remark "the inferior force 
would. . .refuse. . .battle'’ can be proved as a theorem under reasonable hypotheses; (2) the 
remark "the marginal values. . .are greatest when the forces are about evenly matched" can 
probably be proved, but here we assert it on the basis of numerical experience.) To continue, 
it follows that in the case of evenly matched forces, a large part of the value of units is depend- 
ent on final conditions, i.e., on a factor which we have ignored. But not only is this case a 
specially important one, it also is one which we have given prominence in our arguments (the 
straight flow line, the theorems of Brown and Blackwell). 

Our answer to this criticism is, first, that it limits the usefulness of our formulas. 

The formulas cannot be expected to measure marginal values accurately, whether the forces 
are evenly matched or not. They may be expected to measure average values. Second, we have 
the well-known argument from ignorance: the objection does not suggest that our ratio is too 
high, nor that it is too low, and therefore if the final conditions are roughly symmetric then we 
may hopefully use the proposed formulas until someone proposes better formulas. 

The reader may assess the weights of the objection and answer just above. Let us 
notice two possible sources of asymmetry in the final values, cost or difficulty of replacing 
lost weapons, and intrinsic value of human life, both of which may be measured differently for 
the two forces. 

The third criticism is more detailed and less significant, but it may be illuminating. In 
(1), if a= @ then the magnitude of their common value is irrelevant (A depends on a, but v 
and w are unaffected because \ + a remains constant). But if b= 4, B= 1, a=a = 0, then 
one friendly unit has a four-to-one advantage over one enemy; if a= a = 2, the advantage is 
reduced to two-to-one. Is this consistent? The answer is that our (linear) formulas do not 
measure the advantage, which is not even approximately linear. What the formulas aim to 
measure is the numerical ratio of forces required to overcome a disadvantage in firepower. 
We are once more in the position of approximating a curved line with a straight line which is 
tangent at the critical point. 





Turning to the example, the ratio a-a +a - a)? + 4bB to 28 is two-to-one; we 
thence conclude that two enemies are about equally matched with one friendly unit. In fact, in 
the first case (b= 4, 8 = 1, a= a= 0, r= 1, p= 2) we have 8 to 7 odds for winning, and in 
the second case it is 11 to 10 for the enemy. If a and a are increased further, and remain 
equal, we shall have aa@ > bf and must use the other formula. If a= a= 5, the formula says 
that two friendly units equal three enemies; computing the probability of winning in this case, 
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we find it to be .4752. This is a fair selection of the examples we have computed, i.e., the 
formulas seem to be about as accurate as these three examples suggest. The accuracy of the 
model as a representation of battle is a different problem. 


2. THE VALUE EQUATIONS 
We propose to estimate values of units by using the equations 


(A + a;) v= i bij; ; 


r .= oe 
( + a5) W, max Bui 


We have described our procedure loosely as approximating a curved line with a straight line. 
So far it seems more like approximating a curved line with a pound of butter, for there is little 
formal analogy between a stochastic process and a system of equations such as (1). In fact we 
can exhibit a stochastic maximizing problem to which (1) is closely related. 

First, let us notice an inferior alternative. We have already distinguished between the 
"immediate" value of a unit, contributed by use of its firepower in the period of time before the 
first casualty, and the residue, which we called the "survival" value. One can define the imme- 
diate value precisely, by comparison with the alternative process in which the one unit in ques- 
tion cannot be used until after the first casualty occurs. The immediate value may be negative, 
and in any case should be much smaller than the survival value, for large numbers of units. 
Yet, as we said above, our equations seem to get at something like the immediate value. 
Therefore, one may expect that a model resembling that of Part III, but for which (1) is a 
perfectly accurate determinant of values, will involve some scheme for magnification of the 
immediate value. At any rate, our model below does magnify; it does this by repeating the 
period before the first casualty for an indefinite time. 

Let m weapons and n targets be given. Each weapon is to choose a target and fire at 
it until the weapon blows up or the referee stops the game. A hit on the j-th target scores vy; 
points but does not destroy the target. The referee lets play continue for time t or more with 
probability en kt. In an interval dt, if the i-th weapon is firing at the j-th target, it has 
probability a, dt + o(dt) of blowing up and bij dt + o(dt) of scoring a hit. Then one easily 


verifies that the i-th weapon should choose its target j so as to maximize bij Wj; the expected 


total score is ¥ — max bij Wj . Thus the value of the game is the sum of the values Vi of 
oe 


the units, where (k+a;) v= os dij Wj " 


We have now presented all the arguments we know in favor of the estimate we propose, 
with several indications of conditions limiting the usefulness of the estimate. Let us repeat 
that we expect it to be useful over some range of parameters generalizing the range b§ 2 aa. 
Perhaps it is "valid'' when all units are committed to the battle; this is almost surely not the 
best strategy when A< 0. (In the example in Section I1I.3, 4 =V15-1>0. The values from 
(1) are 6 to 5.16 in favor of the friendly force. Yet if all units went into battle the odds would 
be almost exactly even.) However, it is reasonable to suppose (and it is taught) that usually 
the best strategy is to commit all available force to the battle; and frequently it is not even 
possible to keep a safe reserve. Thus our proposed estimate ought to describe, with fair 
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accuracy in most cases, (a) whether or not the friendly force is superior to the enemy, and (b) 
the comparative values of different components, or projected components, of the friendly force. 
There remains the problem of solving (1), which presents considerable difficulties. 
Combining the equations, we obtain 
1 1 


2) vV;=;y7_ Max >, 7 DY; max Ba v,. 
( i“ x+a, "4 X+ a; uy") "hk 


THEOREM 1: Let ai, dij» a Bai be non-negative real numbers such that for each i 
some bi; > 0 and for each j some Bj; > 0. Then there exist a non-negative non-zero vector v 
and a real constant such that (2) holds. 


PROOF: Consider the unit simplex S consisting of all v such that Vv; 2 0 for each i 
and 2 v,=1. Let R be the set of all real numbers greater than the maximum of all -a; and 
1 


-a;. For v in S and \ in R, define T(v,X) = v, where vi = 


+a; ae 7 a, bij “ae B ik YK: 


Let f(v, A) =2 v;- For fixed v, if ’' > A, then f(v,A') <f(v,). We omit the verification, 
, 1 


which is routine but involves a tangled string of symbols; the inequality holds for each coordi- 
nate. Now aS Ao, f(v,A’)->0; as A approaches its lower limit, f(v, A) increases to infinity. 
Therefore, there exists just one = A(v) such that f(v,A)=1, i.e., T(v,A) is in S. We omit 
the routine verification that A (v) depends continuously on v. Now let ®(v) = T(v, A(v)); ® isa 
continuous transformation of S into itself, and hence by the Brouwer fixed point theorem there 
is v° such that ® (v°) =v°. But this means that v° and r(v°) solve (2). 


COROLLARY: If all bij and B ji are positive then all v; are positive. 
PROOF: Some Vj» Say Vy, is positive. Then for each i, 
1 1 
“ii Nea, Nea, Pil Puy Vy 
The corollary is not true without the special hypothesis. Consider a;= a, = 0 for 
i=1,2, j= 1, 2; by 1 = Po9= Byy = 1, Boo= 2, bij and Bij vanish for i + j. One may verify 


> 0. 


that the above corollary, as well as Theorem 2 and some further remarks below, fails for this 
example. In fact the example amounts to two unconnected battles which cannot have the same 
value of A; and we encounter another limitation on the usefulness of our estimate. When optimal 
strategies break up the battle into separate engagements, it is probably appropriate to deal with 
the parts separately. How to combine the results will, of course, depend on what is to happen 
after the separate engagements; we have no suggestions to offer. 

For the remainder of the paper we assume that all dij and ail Bi are positive. We shall 
also write the extra conditions which we have satisfied: 


i aid 


v,7 0 and wi? 9 for all i,j; 


A>- a; and A> ws for all i,j. 
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Given v and A, w is obviously unique and positive. The condition 2 Vv; = 1 enables us to speak 
i 
of uniqueness of v. 


THEOREM 2: In the solution of (2) and (3), A is unique. 


PROOF: Suppose (v, A) and (v',\') are solutions. We may assume \' >, vi > Vv, >0, 
and the ratio t; = v;/v,; is maximum at t, = t. We shall derive the contradiction that v, > 6 ty, 
for some k and a certain @ > 1. Choose k so that for some j, 

»oyk Ie 


Var ’ Vi, - 
1 AN+ay A +a; k 





x a, Mta 1 
Define 6 = ta. Sea since \' > \ and the numerators and denominators involved are 
j 1 





positive, therefore @ > 1. Now suppose that vi <6 tv; we conclude 


Mag Oe Daj Pik 
(AX + ay) Vy =H a, vy, < ot wea, YK 


6t 
< 
2 + 2. 
J 


(A + a;) (A + a) v= (a' + a,) tv, , 


contradicting the definition of t. Hence Vi > tv, another contradiction, which proves the 
theorem. 

Next we shall note that » satisfies at least one algebraic equation in the a's, a's, b's 
and 8's; and we shall show that if v is not unique then A satisfies at least two such equations 
involving disjoint sets of parameters. It follows that v is non-unique only when the parameters 
satisfy certain algebraic equations over the rationals. But if the parameters be chosen at ran- 
dom, the probability that they are algebraically related is zero. Further, the set of parameter 
values for which v is non-unique is topologically non-dense; for only finitely many algebraic 
equations need be examined. Thus we shall conclude 


THEOREM 3: The solution of the system (2), (3) is unique except for a non-dense set 
of parameter values which has measure zero. 
We need to sort the indices, but it will suffice to examine the friendly indices, i, k,...; 
let k be a consequent of i if for some j, 


1 Bi Pik 


“i X¥a, Ata, h* 


Then in a finite set, each index has at least one consequent; it follows that there exists a cycle 
iy, aides iy such that i, , 1 is a consequent of i, for each p and iy is a consequent of in (pos- 
sibly n=1). By eliminating the v's around a cycle of length n, we find an algebraic equation 
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of degree 2n satisfied by 1. Now from the formulas used in proving Theorem 2 we can deduce 
the 


LEMMA: If (v,A) and (v',A) solve (2), then for any positive real number t the set of 
all indices i such that vi >t v, contains all consequents of its elements relative to v'. 
Dually, the set of all i such that v;> : vi contains all consequents of its elements 


relative to v. If v and v' are not proportional, then t can be chosen so that both of these sets 
are non-empty. Then we have two cycles, and two independent algebraic equations satisfied by 
\, Furthermore, there are only finitely many equations to be examined (the highest degree is 
twice the number of indices), Therefore Theorem 3 is proved. 


THEOREM 4: The solution of (2) is a lower semi-continuous function of the param- 

eters. , 
This merely says that the equations are continuous, i.e., a limit of solutions is a solu- 

tion of the limit, which is obvious. One easily deduces the 


COROLLARY: The solution of (2) and (3) is almost everywhere unique and continuous. 


Continuity falls only on the bounding surfaces on which the solution is not (usually) single- 
valued, In fact, we can describe these surfaces as the places where the battle decomposes into 
unconnected parts — an unpleasant possibility which we mentioned above. We omit the tedious 
formalization; the following statement is unambiguous and the interested reader can continue 
the argument of Theorem 3 so as to prove the 

Assertion: The values are non-unique if and only if the battle decomposes into two parts 
so that no weapon in either part has an optimal target in the other part. 

Let us emphasize that the domain in which the present values are inappropriate includes 
not just the singular surfaces but some unknown neighboring regions. 

Having proved the existence and frequent uniqueness of the solution of (2) and (3), we 
naturally inquire how to compute the solution. The analytic argument of Theorem 1 can be fol- 
lowed by apprcximate computational methods, but the labor involved is beyond all reason. The 
best method we have is a well-known, general, and thoroughly unsatisfactory one: guess values 
of Vi and a value of A, substitute them into the right side of (2), obtain new values on the left 
Side, fudge up a new value of 1 somehow, and continue until the error is small or the compu- 
ter is exhausted. We have an example in which, given the correct value of \ but a bad guess 
at v, this method will not converge; however, the method usually works and is fairly rapid for 
small numbers of weapon types. 

For the important special case in which all a; and all a, vanish, there is a finite but 
impractical method which is described by one of the authors in (7). Progress in the study of 
these estimates will be facilitated by the development of better computing methods. 


391368 O- 56-7 
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947), A finite iteration method for calculating the solution of quadratic 
programming problems is described. Extensions to more general non- 
po- linear problems are suggested, 
tions 1. INTRODUCTION 
~ aa The problem of maximizing a concave quadratic function whose variables are subject to 
ort, linear inequality constraints has been the subject of several recent studies, from both the com- 
< | putational side and the theoretical (see Bibliography). Our aim here has been to develop a 
) method for solving this non-linear programming problem which should be particularly well 
_ adapted to high-speed machine computation. 
3 The quadratic programming problem as such, called PI, is set forth in Section 2. 
095- d We find in Section 3 that with the aid of generalized Lagrange multipliers the solutions 
4 of PI can be exhibited in a simple way as parts of the solutions of a new quadratic programming 
\- problem, called PII, which embraces the multipliers. The maximum sought in PII is known to 
be zero. A test for the existence of solutions to PI arises from the fact that the boundedness of 
orge its objective function is equivalent to the feasibility of the (linear) constraints of PII. 
In Section 4 we apply to PII an iterative process in which the principal computation is 
48. the simplex method change-of-basis. One step of our "gradient and interpolation" method, 
sns- given an initial feasible point, selects by the simplex routine a secondary basic feasible point 


whose projection along the gradient of the objective function at the initial point is sufficiently 
large. The point at which the objective is maximized for the segment joining the initial and 
secondary points is then chosen as the initial point for the next step. 

The values of the objective function on the initial points thus obtained converge to zero; 
but a remarkable feature of the quadratic problem is that in some step a secondary point which 
is a solution of the problem will be found, insuring the termination of the process. 

A simplex technique machine program requires little alteration for the employment of 
this method. Limited experience suggests that solving a quadratic program in n variables and 
m constraints will take about as long as solving a linear program having m+n constraints and 
a"reasonable" number of variables. 

Section 5 discusses, for completeness, some other computational proposals making use 
of generalized Lagrange multipliers. | 

Section 6 carries over the applicable part of the method, the gradient-and-interpolation 
routine, to the maximization of an arbitrary concave function under linear constraints (with one 
qualification). Convergence to the maximum is obtained as above, but termination of the process 
in an exact solution is not, although an estimate of error is readily found. 

In Section 7 (the Appendix) are accumulated some facts about linear programs and con- 
cave functions which are used throughout the paper. 





lunder contract with the Office of Naval Research. 


95 


96 M. FRANK AND P. WOLFE 


2. THE QUADRATIC PROBLEM 
Our primary concern is with the problem of maximizing the concave quadratic function 


n n,n 
= i» ee 
(2.1) f (x) A P5%; eet Xj Cj Xe 


J 


subject to the linear constraints 


52° j —— 


n 
2, A, 5x; <b; i 
j= 


Matrix notation will be used exclusively below. x is the nx1 matrix (i.e., column 
vector) of variables Xyy-++9 Xp. A, C, p, and b are, respectively, mxn, nxn, 1Xn, and mx1l 
matrices. A; = (A;1)-- ode A;,) will denote the ith row of A, and likewise A the jth column, 
e. is the jth coordinate (column) vector of n dimensions. The symbol ' denotes matrix trans- 


position. For any function f(x), the gradient 1xn matrix ieee .) is denoted by of. C may 
1 


without loss of generality be supposed symmetric. 
In matrix terms, we may rewrite the quadratic problem as 


PI: Maximize f(x) = px’- x'Cx subject to 


x20 
o { 
Ax<b. 


An x satisfying (I) will be called feasible. The set of all feasible x is the constraint 
set. The problem PI is called feasible if the constraint set is not empty, that is, if there exists 
a feasible x. If the objective function has a supremum on the constraint set, this supremum will 
be denoted by M. An x for which f(x) = M is called a solution of PI and the set of all solutions 
will be called the solution set. It will be assumed in this and the following section that PI is 
feasible, but not that solutions necessarily exist. 

The postulated concavity of the objective function is equivalent to the requirement that 
C be the matrix of a positive semidefinite quadratic form [App. d]. A function is said to be 
concave if interpolation never overestimates its values: that is, if 


(2.3) f(ax+B y) > af(x)+Bf(y) whenever a,B >0, a+B=1. 


It follows that any local maximum point x of f on a convex constraint set is also a global maxi- 
mum: for otherwise a y such that f(y) > f(x) could be found, and then any point on the segment 
joining x to y, no matter how close to x, would yield a higher value for f than would x. Simi- 
larly for a convex function, any local minimum on a convex set is a global minimum. It is this 
fact which makes maximizing a concave function (or minimizing a convex function) one of the 
simpler of the non-linear programming problems. 

Concavity of the objective function implies that a "mixture" of two equally good sets of 
activities can never result in a poorer set of activities. Conversely, the worst possible progral 
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is always "extreme" in that, roughly speaking, it involves as little mixing as is possible. In 
certain cases it may happen that an "extreme" program is also the best program; but this 
may be considered as not a typical case, although not a pathological case either. It appears 
that non-linear programming problems in which (2.3) does not hold — e.g., contract award 
programs if discounts are given for large orders — will require substantially different tech- 
niques than those presented here. 


3. LAGRANGE MULTIPLIERS 

Kuhn and Tucker's generalization [6] of the method of Lagrange multipliers to the maxi- 
mization of a function f whose variables Xyo--+9 Xp lie in the constraint set given by the ine- 
qualities 


(3.1) f; (x) 2 0 (i=1,..., m) 


is based on the observation that f has a local extreme value at x if, and only if, the normal 
hyperplane to the gradient vector df(x) at x is, locally, a supporting hyperplane of the con- 
straint set. (This formulation applies equally well to the classical case f; (x) = 0.) If x is to 

be a local maximum, then the constraint set and the gradient drawn from x must lie on opposite 
sides of the supporting hyperplane. If, furthermore, the constraint set is convex (as when the 
functions fi are convex or, in particular, linear), and f is concave, then, as seen in Section 2, 
this condition is necessary and sufficient that f have a global maximum at x. 

Noting that a hyperplane touching the convex constraint set at a point x satisfies the 
above condition if, and only if, x has the maximum projection (of all points of the convex) along 
the outward normal to the hyperplane, a necessary and sufficient condition that x ‘s be a solution 
of PI is that 


(3.2) d(x.) x, = Max [9 f(x,)w |w>0, Aw< bj, (w an nx1 matrix). 


But by the Duality Theorem for linear programming [App. a] (x, is fixed), the right side of 
(3.2) is equal to 


(3.3) Min [ub | u >0, uA > df (x,)] (ua 1xm matrix). 
Substituting this for the right side of (3.2) and transposing, we obtain that: 


Xo is a solution of PI if, and only if, 


Max [9 £(x,)x, -ub|u20, uA> 2£(x,)] =0. 
Note that 0f(x) = p- 2x'C. The function 
(3.5) g(x, u) = df(x) x - ub = px - ub - 2x'Cx 
extracted from (3.4), which is similar to the generalized Lagrangian of [6], plays a dominant 


role in the sequel. It is evidently a concave function of the variables (x, u). We suppose hence- 
forth that (x, u) is constrained by the linear relations used in PI, (3.2), and (3.4), namely, 
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x>0, u>0, 
i <b, Of(x)<uA. 
Now under these constraints 
(3.7) g(x,u) < 0, 
since g(x,u) = 0f(x) x - ub < uAx - ub= u(Ax - b) < 0, But then the Max of (3.4) is never 


positive, and we have proved the result on which our use of the generalized Lagrange multiplier 
method rests, the 


SOLUTION CRITERION:* x is a solution of PI if, and only if, for some u such that 
(x,u) satisfies (3.6), 


(3.8) g(x,u) =0. 


More information connecting f and g is given by the following easy consequence of the 
concavity of f [App. e]: 
For any x and y, 


(3.9) f(y) - f(x) < Of(x) (y - x). 
If now (x,u) satisfies (3.6), we have that for any feasible y, 


f(y) - f(x) < 0f(x) y - 0f(x)x< uAy - df(x) x 
(3.10) 


<ub - df(x)x = - g(x,u). 


Evidently if f is not bounded above for all feasible y, then such (x,u) cannot be found. On the 
other hand, [App. i] if f is so bounded then there exists a solution, X,» and thus, by the Solution 
Criterion, (x,,4) satisfying (3.6) exists. We have thus proved the 


BOUNDEDNESS CRITERION: f is bounded above on the constraint set if, and only if, 
the joint constraints (3.6) are feasible. 


Finally, supposing in (3.10) that y is a solution of PI—that is, that f(y)= M, we have the 
APPROXIMATION CRITERION: If (x,u) satisfies (3.6), then 


(3.11) M - f(x) < - g(x,u). 


THE PROBLEM PII: From the above it appears that a solution x of PI, if there is 
any, may be read off from any (x,u) for which the maximum, zero, of the concave quadratic 





, 2The Solution Criterion was originally obtained from Lemma | of [6]: our g(x,u) is 
$2 x° + ¢9 u° in Kuhn and Tucker's notation, so that (3.8) is equivalent to part of the con- 
ditions of their Lemma 1. (3.6) is equivalent to the remaining conditions, and Theorems 1 and 
2 of [6] then establish the Solution Criterion. Barankin and Dorfman [1] obtain the Criterion 
and the transformed problem PII in this way. 
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function g(x,u) is achieved under the constraints (3.6). It is, in fact, this latter problem, PII 
below, which is solved in Section 4. Also, the Approximation Criterion (3.11) yields an esti- 
mate f(x) <M < f(x) - g(x,u) for M when any (x,u) satisfying (3.11) is at hand. 

As is customary in solving linear programs [3, p. 339] the constraints (3.6) will be 
written as equations by adjoining one non-negative variable A (i= 1,..., m) to each of the m 
inequalities of A x <b, and one vj (j =1,..., ) to each of the n inequalities of df(x) <uA 
(written for our purposes as - 0f(x)+ uA > 0, or, using matrix transposition, as 2C x + A’ 
>p'), obtaining 


x20, u20, y20, v20, 
(3.12) Ax+ye=b, 
2Cx+ A'u' - v'-=p' 


(y an mx1 matrix, v an nx1 matrix). 
We also have, after substitution from (3.12), 


(3.13) g(x,u) = f(x) x - ub= (uA - v)x - u(Ax+ y)=-(vx+uy). 
In these terms, PII consists in finding vectors x,u, y,v satisfying (3.12) such that 
(3.14) vx+tuy =0. 


This last condition may be interpreted geometrically by noting that it is equivalent to 


(3.15) Vj #0 implies X; = 0, u; # 0 implies ¥,* O (all i, j). 


Since 0f(x)=uA - v= Lv, (-e,)+ 2 u; A; is an expression for f(x) as a non-negative linear 
combination of the outward normals to those bounding hyperplanes e.x = 0, A x= b; on which 
Xx lies (i.e., for which Xr Yj vanish), the solution criterion (3.14) is equivalent to: 


(3.16) x solves PI if, and only if, df(x) belongs to the 
convex cone spanned by the outward normals to the 
bounding hyperplanes on which x lies. 


This condition is a geometric dual of the condition stated at the beginning of this section, and 
has been obtained from it by the duality theorem for linear programming. 


BASIC SOLUTIONS: The system (3.12) consists of m+n equations in 2(m+n) non- 
negative variables. It is easily shown that any extreme point of the set of points x,u,y,v fea- 
sible for the constraints (3.12) has at most m+n positive components. An extreme point of 
this convex will be called a basic feasible vector.3 Evidently the solution of a linear program 
can always be found as a basic feasible vector and the simplex process does precisely so 
[App. b]. 








3After Dantzig. Under the non-degeneracy hypothesis of [3], a basic feasible vector has 
exactly m+n positive components. 
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Now the conditions (3.15) entail that at most m+n components of any solution of PII are 
positive, so that we may hope to find a solution of PII among the basic feasible vectors of the 
constraint set for PII. We show in Section 4 that this is indeed the case. 

This remarkable consequence of the use of Lagrange multipliers might suggest the 
direct use of the simplex method to maximize the objective function; however, as discussed in 
Section 5, this is not possible. Nevertheless, the simplex method machinery is usefully 
exploited in the "gradient-and-interpolation"' method presented in the next section. 


4. THE COMPUTATION 


PRELIMINARIES: For present purposes the four interdependent vectors x, u, y, v 
may be combined into a single constrained vector z. Accordingly let 


p-| 49 1 0 
, ~19¢ a’ Oo -1 |’ 


the two instances of I being identity matrices of appropriate rank. z, B, and d are then 
2(m+n)x 1, (m+n)x 2(m+n), and (m+n)x 1 matrices, respectively; and the system of 
constraints (3.12) for PII assumes the form. 
(II) z>O, Bz=d. 

With each z as above associate the "adjoint" 


(4.2) z= [v, y', u, ci. 


The new objective function may be conveniently expressed using this linear operation, for by 
(3.13) 


(4.3) g(x,u) = -(vx+uy)= -522. 
Further, for z= [x', u, y', v]' and Z= [X', U, Y', V]' feasible with respect to (II) above, 


(4.4) 


‘stn and 
(Z - z)(Z-2z) 20. 


The first relation is evident. The second relation is given by 


5 (Z -2) (Z -z) = (V-v) (K-x) +(U-u) (Y-y) 
=[2(X-x)'C + (U-u)A] (X-x)+ (U-u)A(x-X) 


= 2(X-x)'C(X-x)>0, 
which thus reflects the concavity of g. 





4This has been shown independently by Barankin and Dorfman when the system (3.12) is 
non-degenerate [1]. 
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In these terms, the final version of the Lagrange multiplier problem obtained in the last 
section may be stated as 


PII: Find z for which the maximun, zero, of the inner product 


is assumed under the constraints 


(11) 


By the Boundedness Criterion, PI has a (finite) solution if, and only if, PII is feasible; 
by the Solution Criterion, x solves PI if, and only if, z= [x' u y' v]' solves PII for some y, 
u, and v. 

Although this has not been necessary before, for application of the simplex method we 
suppose that the constraint equations (II) have, where necessary, been multiplied by -1, so that 
the right side is non-negative. 


THE ALGORITHM: The process below will yield a basic feasible vector solution of 
PII. Phase I initiates the process, while Phase II is iterated until it yields the required vector. 

Phase I: The constraints (II) are tested for feasibility. (Most commonly employed is the 
artificial basis [App. c].) If they are feasible, a basic feasible vector Zy is produced with 
which to begin Phase II. If not, the last n equations may be discarded and the remainder simi- 
larly tested for feasibility. If these are feasible, then the quadratic problem is feasible, but 
unbounded above; otherwise, the quadratic problem is infeasible. 

Phase II: This phase is defined inductively: At the th instance of Phase II we have the 
feasible (II) vector Wy which does not solve PII, and also a basic feasible vector Z, with which 
to start the simplex machinery. (At the first instance, let W,= 2 a 

Employ the simplex technique in the maximization of the linear form 


~W, 2; 


obtaining the sequence of basic feasible vectors zi = Zs 2°, 2°, .. such that 


-w, 2" < -w, 2" < 1s ™ 


Stop at the first 2h such that either 
(4.5) 


(4.6) 





5In the likely event that the constraints (II) are degenerate, ''<'' may occur here for a 
while, but not for long. Dantzig's method for handling degeneracy [2, 4] is exceptionally easy 


to use here, owing to the presence (except for sign) of an identity matrix in the constraint 
matrix. 
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If (4.5) obtains, then zh solves the problem. Otherwise let 


24172 


Wy (Wye - 244) 
pf = Min 1>, and 





(2 ~ My) ea - My)” 
Wen = Wig tH 41 - My) - 
Repeat Phase II, using We+] and Ze 1° 


PROOF OF CONVERGENCE: It will be shown that the new objective -W), Wy con- 
verges monotonically to zero, and that in some instance of Phase II a basic feasible vector 
solution satisfying (4.5) is found. 

(a) In order to show that zh satisfying (4.6) will be found in a given instance of Phasell 
(if (4.5) is not obtained), it is sufficient to observe that the linear programming problem 
Max {- Wz | (II) } has a finite maximum, since - WZ <0. This maximum is‘not less than 


1~ ~ ~— - a 
- Ww), W,, Since if Z solves PIl, i.e., ZZ =0, we have w, w, - 2w, Z= (Ww), - Z) (Ww). - Z) 20, 


by (4.4). 

For the time being, let w, = w, 2, ,,= Z, W,,,= W. Then (4.6) yields w(w - Z) 
> = W w > 0, and (4.4) that (Z - W) (Z - w) > 0, so that 0 <u <1 (no difficulty arises if the 
denominator in the expression for 4 vanishes). Thus Wiad is a convex combination of Wy 
and 2413 indeed, it has been chosen so as to maximize the new objective on the segment 
Wi 241° 

(b) Convergence. Dropping subscripts as in (a), when Z = z 
obtained in the «th instance of Phase II, we have 





h satisfying (4.6) is 
WW = Ww 2uW(Z - w) + 2(Z - W) (Z - w) 
= Ww+uw(Z - w)+ u[u(Z - W) (Z - w) - Hw - Z)] 


< Ww+u W(Z - w) 


1 


Ww-1-<¥w 


_— 
Len ww. 
( 5H) 


Letting F be the (compact) convex hull of the set of all basic feasible vectors of (II), let 


(4.9) L= Max {(z) - 2%) (21 - 2%) | 21, 2? in F}. 
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If » < 1, then 


so that, in any case, 


and finally by (4.8) 


(4.10) 


Resuming subscripts, let a= aL Then (4.10) becomes 


(4.11) a4 1 < Max {1 - ay 5} a for k>0. 


Since if a, > F then a4 < 3 a,, there exists K such that ay, < ; whenever k > K. Now for 


ay <5 we have a |, < a,(1 - ay), whence 


2 
1 1 1 l+a tat... 


Pe. 3 
a4] yy 1- ay ay 





Hence Wi, Wy approaches zero at worst like 1/k, and the convergence is proved. 


(c) Finiteness. Now suppose that the linear program of Phase II never yields a basic 
feasible vector which solves PII; then in particular no Ze obtained in the iteration of Phase II 
Solves PII. Since each Wy is a convex combination of { 1 |k'<k }, there is a point of 
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accumulation w,, of {w,}; belonging to the convex hull of the finite set of basic feasible vectors 


{2 2,2, >0 } for which WW, =0; yet wo = Zt, 2 with t, 20, Zt, =1, so that WoW 


= = tj te. 2, Z, > 0: acontradiction. The proof that Phase II terminates in a solution is com- 
j,k 


plete. 

(d) Approximation. Some iterations of Phase II can be avoided if only a solution of PI 
to a predetermined degree of approximation is desired; for the Approximation Criterion (3.11) 
yields that, where Xy is the x-part of Wy» 


a we 


Phase II is repeated until WW is sufficiently small. 


Computation Time: Experience with a few very small numerical examples (of the order of 
n = 5, m = 3) suggests that the total number of changes of basis (several in each instance of the 
application of the Simplex Technique to Phase II) required to solve the quadratic problem will, 
in practice, be of the order of 2(m+n). The instances of Phase II after the first commonly 
require only one or two changes of basis. Thus this algorithm may be able to solve quadratic 
problems as quickly as linear problems of comparable size can be solved; but we have no theo- 
retical estimate for this. 


5. OBITER DICTA 

We briefly consider here some alternative computational proposals which aim directly 
to exploit the fact that some basic feasible vector of (II) is a solution of the problem PII by 
using the simplex change of basis to pass from a basic feasible vector to adjacent basic feasible 
vectors. 

Perhaps the most attractive possibility is that of the existence of a function defined for 
basic feasible vectors which assumes its minin.1m at a solution and which can always be 
decreased with a single change of basis if the solution has not been reached. In view of the 


Solution Criterion (3.8), the function -g(x, u) = 5 zz naturally merits consideration from this 


angle, as well as the integer-valued function which counts the number of positive components 

of z that coincide in position with the positive components of z; these functions have been 
studied by Barankin and Dorfman [1]. Quadratic programming problems may be constructed, 
however, in which certain non-solving basic feasible vectors occur as "local minima" for these 
functions, which cannot be decreased with a single change of basis. Whether or not a function 
of the desired type exists is not known. 

One could also systematically explore all the basic feasible vectors of (II) for a solution, 
changing basis to pass from vertex to adjacent vertex in the graph consisting of all the basic 
feasible vectors and their connecting edges in (II). Such a process has been proposed by 
Charnes [2] for obtaining all solutions of a linear programming problem, given one. The 
amount of information that must be recorded if a graph of unknown design is to be traced out 
has been studied as the "labyrinth problem" [5]. The tracing process becomes less efficient 
(in terms of edges retraced) the less the data recorded. A minimum record is a list of all 
vertices already traversed. The best available upper bound [7] for the number of vertices of 


(II) being of the order of nar 7 , it seems that such an approach to PII would be infeasible 


for large-scale problems because of the excessive demands made on the memory of a high- 
speed computer. 
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6. CONCAVE PROGRAMMING 

The gradient-and-interpolation method of Section 4 applied to the quadratic concave 
function g(x,u) may be equally well applied to the problem of maximizing a more general 
concave function f, satisfying the hypothesis (A) below, whose variables are constrained by 
linear relations. Generalized Lagrange multipliers do not seem to have the same utility here 
that they do in the quadratic case, since the constraint 0f(x) < uA entailed by their use is no 
longer linear, and thus the features which ensured the termination of the quadratic program- 
ming in a finite number of steps are not found here. 

Let f be a concave function of n variables possessing continuous second derivatives. 
The concave programming problem is: 


PC: Maximize f(x) under the constraints 


(6.1) x>0, Ax<b. 


t) 
Here A,b are mxXn, mx1 matrices, df(x) is the 1xn matrix (Ge) a” f(x) is the nxn 
2 i 
r) —j 


OX; OX; 


matrix ( 


The problem will be supposed to satisfy the hypothesis 
(A): For each feasible x, {df(x) y |y feasible} is bounded above. 
In particular, (A) holds if the constraint set is bounded, and in any case implies that f 
is bounded above on the constraint set, since for x fixed we have [App. e] the consequence of 
concavity 


(6.2) f(y) < £(x)+ Of(x) (y - x). 


(A) is also easily shown for the problem PII. 

Supposing now that the problem is feasible, let F be the (compact) convex hull of the 
set of basic feasible vectors of the constraint set. Such basic feasible vectors exist, since by 
(A) the linear program Max {6f(x)y |y > 0, Ay < b} has solutions. There exists, then, a con- 
stant L > 0 such that for each x, y, and w in F, 


(6.3) -(y - x)’ a2 £(w) (y-x)<L. 


The computational method follows. 
Phase One: As in the quadratic case, determine the feasibility of the constraints (6.1), 
obtaining the initial basic feasible vector Zy- 
Phase Two: At the qth instance of Phase Two, when we suppose given the basic feasible 
vector z, and the feasible vector X, (x, = 21) find a basic feasible vector z, ,, which solves 
the linear program 


(6.4) Max {0 f(x,) w | w 20, Aw<b}. 
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Let s be such that 


for all w on the segment Xe 244 © Let 


df (x,) (244 - x) 
ft = Min . eae 





X41 = + (244 - X;,) . 
and repeat Phase Two with 2419 ea: 


PROOFS: We shall prove that f (x,) converges to M, the supremum of f on the con- 
straint set. Let for the moment xX, =X, X44 = X, and 2417 =Y- 


From (6.2), for any feasible w we have f(w) < f(x) + af(x) (w-x) < f(x) + a f(x) (2 44 


- x) = f(x) + df(x) y, since 2, , 1 maximizes df (x,); and thus 
(6.7) M - f(x) < df(x) y. 
Now by Taylor's theorem, since 0 <u <1, 


2 


£(X) = f(x +my)= f(x) +u atx) y+ Zu" y' a few) y, 


where w lies on xX, so that, from (6.7), (6.6), and (6.5), 


M - £(K) = M- f(x) - Zu af(x) y - Su [af(x) y+ wy! 2” £(w) y] 
1 1 yi ase 
M - f(x) - 54 [M - £(x)] - s[su +py a° f(w) y] 
(1-H) (M - f(x) ]. 


Since, moreover, 





L 


t= fu = Max {1-$, d f(x) y pe max{s, Mate}, 


-y' 7 t(w) y 


(6.8) yields, dividing by L, resuming subscripts, 





bor course s < L. For this method, s should be chosen as small as possible, but we have 
no suggestions for finding it. 
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(6.9) 


M - f(x, , 1) M - f(x,) M - £(x,) 1 
L —L~ eS se 


~ 


which is the same as (4.9) with = replaced by = . so that 5 - 
4L L 


L 


x) converges to zero 


1 
like —, and f(x,)-M. 
k’ k 
Finally, we have in analogy to the Approximation Criterion of Section 3 the estimate for 
M given by (6.7): 
(6.10) f (x,) <M< f (x,) +0 f (x,) (244 - x) . 
This estimate improves throughout the process; letting 2417 % = Vue» we show 0 £(x,) Yy¢ — 0. 


k 
> Y? 


Let O. = Min {0 f (x;,) Vue L}. Then for some w between x and x + L 


2 
fs) 5. ) 


k os  & 
M 2 f(x + —— yy) = fq) + — 0 £(x,) y,+ 272 k° f (w) Vx 


2 2 
5, OK O. 
2 1(m,) + —- oft) %, TI > f (x,) + = 


Since {(x,)>M, we have 57 0. 


In the absence of the property (A), a modification of the gradient-and-interpolation 
procedure which takes account of possible infinite solutions of the linear program (6.4) can be 
made, for which convergence of the function to the maximum can be shown; however, estimates 
of the rate of convergence (6.9) and error (6.10) cannot be constructed. 


1, APPENDIX 
(a) The duality theorem for linear programming asserts, where A, b, c are, respec- 
tively, mxn, mx1, 1x n matrices: 


sup {cx |x 20, Ax< b}=inf {ub|u> 0, uA 2c}, 


the supremum (infimum) over an empty set being - © (a); the extrema are assumed if finite. 
(b) The simplex method for solving the linear program Max {cx |x >0, Ax=b} 
employs at each step the basis consisting of m columns of A such that their totality B is 
nonsingular and Bb 20. The vector having components B™ 1» with appropriate zeroes 
adjoined is a basic feasible vector. A change of basis replaces one column of B by another 
column from A in such a way as to increase the objective cx on the basic feasible vector. 
be is continued until the maximum is attained. The constraints are non-degenerate if always 
Bb >0. The non- degeneracy assumption of [3] has been removed [4]. 
(c) An initial basic feasible vector for the linear program is found by applying the 
Simplex method to the expanded problem Max {-y |x >0, y >0, Ax+Iy=b},x=0, y=b2>0 
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being an initial basic feasible vector for this problem. If Max < 0, then the original problem is 
not feasible; otherwise, for the Max, y = 0, so x is a basic feasible vector. This formulation 
is used with a further modification to eliminate degeneracy [2, 4]. 

(d) The function f (having continuous second derivative) on the convex set S is concave 
if, and only if, for all x, y in S and 0 <p <1, using h(yz) = f(x + uw (y - x)), we have h''() < 0, 
whence: 


(7.1) (y - x)' a7 £(w) (y- x) <0, 


for all w between x and y, is a necessary and sufficient condition for concavity. If S has 
interior points, (7.1) is equivalent to the condition that the matrix a2 f(w) be negative semi- 
definite. 

If f(x) = px - x'Cx then @ 
positive definite. 

(e) For f as in (d), if x, y €S, by Taylor's theorem 


2¢ = -C, so that f is concave for all x if, and only if, C is 


f(y) - £(x) = 2 £(x) (y - x) +3 - x)' a? £(w) (y - x) 


for some w between x and y, so that 
(7.2) f(y) - f(x) <af(x) (y - x) 


is a necessary condition for concavity of f[6, Lemma 3]. If the left of (7.1) is positive for some 
x, y, W, then X, ¥ can be chosen sufficiently close to w that (y - x)’ a2 f{(w) (y - x) >0 for all 
W between xX and Y, so that (7.2) fails, whereby it is also sufficient. 
(f) Since, in general, if f is concave then {x |f(x) 2c} is convex for all c, the solution 
set {x€S|f(x)2 Max} of any concave program on a convex set S is convex. 
(g) If C is positive semi-definite and symmetric and x'C x = 0 then for all pw and z, 
0 <(x+ pz) C(x+uz)=2yx'Cz+ u22'Cz, so that x'C z= 0 for all z, whence x'C =Cx=0, 
(h) If x and y belong to the solution set of the quadratic problem, then for all 0 <u <1, 


M =f (x+y (y - x)) = £(x) + wat (x) (y - x) - Su? (y - x) C(y - x), 


whence (y - x)' C(x - y) = 0, so (y - x)' C =0, hence f(x)= p - 2x'C = p - 2y'C= f(y). Thus, 
éf is constant onthe solution set. Furthermore, f(x + u(y - x)) =f(x) for all u, so that the 
solution set is the intersection of the constraint set with some linear manifold. 

(i) We prove by induction on k that if the quadratic function f(x) = px+ x'Cx (not 
necessarily concave) is bounded on the polyhedral convex set R of dimension k, then it assumes 
its supremum on R. 

We may write any k+ 1-dimensional polyhedron R as {s+ uwt|seS, teT, uw > 0}, where 
S is a certain bounded convex polyhedron and T is the intersection of a certain convex poly- 
hedral cone with the unit sphere. Since for reR, teT, f(r +ut) =f(x)+ w(p+ 2r'C)t 
+ u*t'ct is bounded for uw > 0, t'Ct <0 for all t in T. 

If, on the one hand, t'Ct <0 for all t in T, then there exist 5 > 0 and D such that 


t'Ct <-6 and (p +2s'C)t <D for all t in T and s in S, so that the maximum of f isassumed 
on the compact set S+ B 7. 
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lem is Suppose, on the other hand, some ¢ Cc ‘.° 0. If for all reR we have r+u t,eR for 
ition all p, then the boundedness of f(r +t) implies (p + 2 r'C)t °* 0 for all r, so that the values 

of f on R are unchanged by projection into the k-dimensional subspace normal to t ™ to which 
ncave the induction hypothesis may be applied. 


Bw) <0, Otherwise, for each r, r +t ,¢R for some pL, so that for each r, b, = r+ Min {yu |r 
+p teR }t, lies on the boundary of R, and f(b,.) 2f(r), since (p+ 2r' C)t, <0. Since the 
supremum of f on each k-dimensional bounding hyperplane of R is assumed, so is it on R. 
(Irving Kaplansky has pointed out that the above result does not obtain for polynomials of 
degree greater than two. It is clearly not true for polynomials of odd degree; and the function 
x2 +(1- xy) does not assume its greatest lower bound, zero, on the plane.) 
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THE OPTIMIZATION OF A QUADRATIC FUNCTION 
SUBJECT TO LINEAR CONSTRAINTS 


Harry Markowitz 1 





The author discusses a computational technique applicable to 
the determination of the set of "efficient points'' for quadratic pro- 
gramming problems. 











1, QUADRATIC PROBLEMS 
Suppose that variables xX; BON Xn are to be chosen subject to linear constraints: 


0 Za, X= bj, i=1,...,my 


; (2) Za; Xj2b,, i=m,+1,...,m 


| (3) x, 20 
where 0 < m, < m, 0 <N, <N and the matrix (aj;) i=1,...,m, has rank m, (otherwise the 
system is inconsistent or has at least one redundant equation). The payoff is a linear function 
R= zr; x; whose coefficients r. are not known at the time the X, are chosen. The Tj , rather, 
| are — variables with expected values pu j and covariances Fix (including variances 
4 of ). The expected value of R is 


4 = . X, 
(4) E Zp; X;. 


| The variance of R is 


(5) V=22 O55 X; x, - 

| Suppose further that some decision-maker likes 
expected payoff (E) and dislikes variance of pay- 
off (V). Our problem is to compute for the 
decision-maker (a) the "efficient combinations" \ 
of E and V, i.e., those attainable (E, V) combina- 
tions which give minimum V for given E and max- 
imum E for given V (Figure 1); and (b) the points 
inthe X space associated with the efficient E, V 
combinations, i.e., the set of efficient X's. 


a 
os ~ 
i ATTAINABLE E,V 


COMBINATIONS Je— EFFICIENT 
E,V COMBINATIONS 











The writer has particularly benefited from discussions with Kenneth Arrow on the subject 
matter of this paper. 
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A computing technique is presented in this paper for generating the above efficient sets, 
An adaptation of this technique can be used for problems of maximizing or minimizing quadrati; 
forms (with the "right" properties) subject to linear constraints. 

The practical problem which first suggested the above computing problem was that of 
selecting a portfolio of securities. Here x; is the amount invested in the j~ security; the np. 
and o ik are the expected returns and covariances of returns from the various securities. In 
the simplest case the constraint set is UX; +3, x; > 0. A problem of very similar structure, 
analyzed independently by H. S. Houthakker,? is that of finding the expenditure on various goods 
as a function of income for an individual whose utility function is of the form u = Za; X; + 
zZa;. ij x i %j- A problem of maximizing a a quadratic profit function subject to 
linear iene is presented by Robert Dorfman.* Another problem of this general charac- 
ter is that of maximizing a quadratic likelihood function where there is a priori information 
concerning the values of parameters to be estimated. Now that reasonably convenient comput- 
ing procedures exist for such quadratic problems we may be permitted the hope that still other 
classes of interesting questions can be reduced to this form. 

This paper will discuss only minimization problems involving the quadratic form 
rzo;; ij Xj Xx; whose matrix (0; j) is positive semi-definite. The reader should have no difficulty 
in tlpoting the results to atieintuaitnn problems involving 2p; X;+ 22 o. Xj X; where (0; ) 


j ij ) 
is positive semi-definite or maximization problems where (0; j) is negative heme definite. 


2. ASSUMPTIONS 

According to customary usage we Say: 

(a) A set of points (S) (in Euclidean n-space) is convex if x1) € S and x(2) € S imply 
ax) , (1-»  x(2) S, for any 0<, <1. 

(b) A set is closed if X, ,...,X,,...—> y and X,,. »X,,- .€ Simply ye S. 

(c) A function f(X) is convex over a set S if x(1) eS, (2) 5 and [ ax), (1- rn) x(2) 3 
imply ¢ (ax!) 4 (1-n) x(2)) <r eK) 4 (1-ay £¢K(?)) for all O< 2 <1. 

(ad) A function is strictly convex over a set S if X 1 e S, x(2) e S and [A x(1) + (1-) yx" 
€ S imply £(aX™) + (1-n) x) <a 0K) + (a-ay £00") for all O< a <1. 

The set (S) of points which satisfy constraints (1), (2), and (3) is a closed, convex set. 
Variance (V) is a positive semi-definite quadratic form, i.e., z . ik x; xX, > 0 for all 
(X, aaks » Ky). It is also convex. The covariance matrix (o 4) is non-singular if, and only if, V 
is positive definite ji.e., > D0., X. X, > 0, if (X,,...,X,,) 4 (0,...,0)}, which in turn is true 

{ ik jk “j “k 1 N } 








if, and only if, V is strictly convex over the set of all X.> 





2Harry Markowitz, ''Portfolio Selection," Journal of Finance, 1952. 

3"La Forme Des Courbes D'Engel,"' Cahiers du Séminaire d'Econometrie, 1953. 

4Application of Linear Programming to the Theory of the Firm, University of California 
Press, 1951. 

5 That V(X) 20, mie all X, is due to the fact that V is the expected value of a square, 
E(r-Er)2, and therefore cannot be negative. That |0j;! #0 if, and only if, V is positive definite 
is a corollary of material found, e.g., in Birkhoff be Mac Lane, A Survey of Modern Algebra, 
Chapter IX, particularly section 8, pp. 243-247. The implications of positive definiteness and 
semi-definiteness for convexity may be seen as follows: Let C = (0jj). Let X and Y be colum 
vectors; X' and Y' be row vectors. C is symmetric so that C = C' and X'CY = Y'CX for any 
X,Y. We wish to see the implications of 














(1) X'CX 
(2) X'CX 
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We will assume!9 that § is not vacuous. We will also assume that V is strictly convex 
over the set of X's which satisfy the equations 


Bay Xj;= bj, i= 1,...,my. 


This assures® us that V takes on a unique minimum over § and that if E = oh is attainable in Ss, 
then V takes on unique minimum over the set 


Sn {x \Zu, X; 2 Ep}. 


If a function is convex over a set S, it is convex over any subset of S; therefore lo;;! # Oimplies 
that V is strictly convex over {X |= ai jX; =b,i=1,..., my}. This is not a necessary condition, 


however. Necessary and sufficient conditions on A and (o ij) = C are discussed in the footnote.’ 





5(Continued) 
for the difference 


D = [AX'CX + (1-X) Y'CY] - [(AX' + (1-A)¥") C(AX + (1-2) Y)). 
Expanding the second term and subtracting we get 
D = \(1-\) - [X'CX - 2X'CY + Y'CY] 
= \(1-\) + [(X'-¥"') C (X-Y)]. 


Assumption (1) implies D > 0 for all X,Y. Assumptions (1) and (2) imply D > 0 if X 4 Y. Con- 
versely, if D is positive for all X # Y, letting Y = 0 we find X'CX > 0 for all X #0. 


®since equations (1) have rank mj, m, variables and the m, equations could be eliminated 
(as in footnote 7) to leave a system with N-my, variables and (m-m)) + N] inequalities. V is 
strictly convex in these N-m] variables and therefore the associated quadratic is positive defi- 
nite. Let Y be any point in the space of the N-m] variables satisfying the (m-m)) + N, inequali- 
ties. The points which satisfy these inequalities and have V < V(Y) form a compact, convex set. 
Since V is continuous, it attains its minimum at least once on this set. Since it is strictly con- 
vex, it attains its minimum only once. The same argument applies if the constraint 


.X: 0 
z Mj Xj >E 
is added to the (m-m)) + N) inequalities. 


7Suppose mj} 21. Since /a))...ajyN has rank m, we can write, after perhaps relabel- 


4m) N°" 4m)N 
ing variables, 


411°++41m) x) 2)m)+1°** 21N Xm) +1 by 


am} 1---4m)m, Xm) 4m )m)+1°'*4m)N Xn bm, 


or Al!) x(1) 4 al2) x(2) = b where Al!) is non-singular. We thus have x(1) - (A(1))-1p - 
(a(1))-1 A(2) x(2), We can express V in terms of x(2) by substitution, i.e., 
xD) (=A) 4-1 gd) 


X = . 
x?) 0 I 


(1) 


( Continued) 
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3. THE CRITICAL LINE 7% 
Let us first note the answer to a simpler problem than that of finding all (E, V) efficient 
points. Suppose we wished to minimize V subject to the equations 


way; Xj = b;, i=1,...,my 


without regard to the inequalities (2) and (3). A necessary condition for a minimum is that 
xX; pice Xn be a solution to the Lagrangian equations, 


a (Zz ij %, x, -2 2A 


Zz. &. m,) 
(6) ee 
dX, 


i 





as well as Za,, X;= b, , i= 1,...,m,, i.e., 


N 


(7) ery Oe te * S — 


(8) Za X= b,, i=1,...,m,. 


Given the assumption that V is strictly convex over {XIE aj 
that 


5% =, i = 1,...,my} it follows 


Co soe @ a ee 

11 IN “11 My 
on “ee oNN ain ee¢ 4m,N 
any r++ Ag - wee @ 


ee oe 
m,1 m,N 





7(Continued) 


(1)-1 (1)-1 (2) y(2) 
= [tot A=, gy — ¢x(2)" a2)" A=, y2h7¢ [ (FP) A AX 
0 x(2) 


A()-lp A(l)-ly 
=(b' AM)'-1 gy ( . - 2x(2) ¢al2)' aQ)'-1 ne . 


(1)-1 a(2) 
+ xf2)"| caer srt, 96 (4 Se )) xe. 


V is strictly convex for all x(2) if, and only if, the last (i.e., the quadratic) term is strictly 
convex. This is so if, and only if, 


(1)-1 ata 
I 


(al2)' A(l)-1") Ic ( 


is non-singular. 
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is non-singular .® Since a strictly convex V takes on a unique minimum on a convex set, the 
unique solution to (7) and (8) is this minimum. 

Next consider the problem of minimizing V subject not only to (1) but also to the con- 
straint that E = Ey i.e., 


N 
(9) > uw, X, =E,. 
j=1 J J 0 
We must distinguish two cases: 
Case 1: The row vector (My biel hae Hy) can be expressed as a linear combination of the 
(ajy--- » Bin) i.e., there exists a,,..., Ams such that 


™ 3 


(1 5-2-1 %,) : 2 = (Hy,---, Hy) - 
4m,1 ‘°° “m,N 


Case 2: There does not exist such a linear combination. 
As is shown below,? in Case 1 only one value of E, say E = E*, is attainable. There- 
fore if we require E # E* no solution can be found; if we require E = E*, equations (7) and (8) 
give the minimum. In Case 2 the matrix 


C1, -** Mn? 4m,N My 


- °NNAIN -°> 4m N #N 


de Na Oo Oo 


a e+ Cage? =<: Oo Oo 
Hy «++ My o ...,0 Oo 





8i¢ mj) = 0 the statement reduces to one proved in footnote 5. Suppose m, 2 1. If * 4 


A O 
hc, . Y O C A' Y oO} . 
is singular there is a vector |_,] # |g} suchthat |, 6 -r.] = lo] ie 


' 
vod = S . Since the rank of A is m there is no } # O such that A'\ = O, therefore Y #Oin 


Y 
.) above. V(Y¥) = Y'CY = Y'A') = (AY)') = O. Let X be any point in S = {X | AX = b} where 
x' = (X),-.-,Xy) 
Tim 
b = (by +--+ byny) 
A(X + Y) = AX + O = b; therefore X + Y is inS 
V(X) = X'CX 
V(X + ¥) = X'CX + 2X'CY = X'CX + 2X'A')A = X'CX + 2b'd 
V(1/2X + 1/2(X + Y)) = V(X + 1/2Y) 
X'CX + X'CY 
X'CX +b'd 
1/2 V(X) + 1/2 V(X+Y), 
thus contradicting strict convexity. 
9If a'A =yu' and AX = bthen E = u'X = a'AX = a'b. 
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is non-singular,!9 and therefore the equations 


(11) ZO 5, Xi, +Z(- ry) aij -ARp M; = 


(12) Bay X,=b » i=1,... 


(13) Em X; = £° 


have a unique solution which gives minimum V for the specified Eo. If we let EO? go from - oto 


+ ©, the solution to (11), (12), and (13) traces out a line in the (X,A) space. This line may also 
be described as the solution to the following N + m, equations in N + m, + 1 unknowns: 


N — 
- ee et tes 88s Ft. 


(15) Bai X,=b, , i= 1,.. 


or 
(16) 20 jx X;, + 2 (-d 5) aij= AEH} 
(17) 


Za, Xj = bj 4 8 EE. 


for - © < Ap £+o. 


Since the matrix of equations (16) and (17) is non-singular, given our assumption of 
strict convexity, they have a solution for every value of AE whether we are in Case 1 or Case 
2 above. In Case 1 the values of X,,--.,Xy do not change (only the values of the A's change) 
as Ap goes from -© to+@.!! In Case 2 the X's as well as the A's change. In Case 2-we can 
define V(E) to be minimum V as a function of E - 2rp = dv /dE - V(E) must be strictly convex; 
therefore, E increases with AE: In Section 11 we show that V(E) is a parabola. 

4. CRITICAL LINES /4(3,4) 

The set of points (X,’) which satisfy (16) and (17) will be referred to as the critical 

line 2 associated with the subspace 


S={XIz aj; X; = bj for i= 1,...,mj}. 


Critical lines will also be associated with certain other subspaces. 





10same proof as in footnote 8, using the fact that 


() 
un has rank my + kL. 


a c A' x0 ' 0 
For if w= A'K and ( ) (Xo) = B+ (B) a2 then ( *) (% e 
N o/ E A O/ \x" +ia 


AO 


a 





(1 


F 
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Let Xj aes Xi be a subset of variables. Let 
1 J 


Zajj Xj = bj ’ i= iy,...,iy 
be a subset of the constraints (1) and (2) with the inequalities replaced by equalities when i > mM). 


Let 3 be the ordered set of indices (iy psu aeen ip); let ¢ be the ordered set (i, aoe Jy) . We will 
be particularly interested in 3 and { of the form 


(18) 3 ={052,-.65mys ty ages off) where I 2m, 


(19) | ={j,,---sd,,, Ny +1,...,N} where 0< L<N,. 


For any indices 3 and { satisfying (18) and (19) we define the submatrix 


a: . <= Sas 
te dy 
Ag = 


We similarly define subvectors Xq » Ag and 


--( 


also submatrices 


(23) My 


If I = m, = 0, 3 is empty. In this case it will sometimes be convenient to think of A gg as 
having no rows and J columns. To every (3, ¢) satisfying (18) and (19) we associate a subspace 


$(4,4) = {X1X; = 0 for j¢ 4, A gq Xq = By}. 
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If Ayq has no rows this reduces to S(4) = {X| x; = 0 for j €4}. Since 3 and § satisfy (18) ang 
(19), S(3,4)¢8. Since V is strictly convex over §, it is strictly convex over S(4, 4). 
Agq has a rank of I or less. If Agq has rank I then the matrix 


(24) 


is non-singular. (This is a special case of the proposition proved in footnote 8.) If Ay has 
rank less than I, M A is singular, for its last I rows are not independent. For every (3,4) 
satisfying (18) and (19) whose A M4 has rank equal to the number of its rows, we define the 
critical line 4yq to be the set of points (X,,... Kags Apoeees An) which satisfy 


for j¢ 4 
(25) 
fori¢g 4 


Xq fe Oo 1 Hg 
(a) “Mag af * Mag (3) /- 


Equations (25) may be written in the form 


(26) Kj = %j +P xj 


~O<AR<@. 


Equations (26) by themselves are the projection of 4(3,4) onto the X-space. As with S and 2 
we have two cases: 

(1) Only one value of E is obtainable in S(i,{) and the X-projection is a point. 

(2) All values of E are obtainable and the X-projection is a line. This line is the set 
of X's in S(3,4) which give minimum V for some E. Let 


(28) ky = Za X,- by , 


m 





1/2 
aX; 


N 


J 


Constraints (1) and (2) state that 
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A 0 for i 
A Z for i 


Along any critical line we have 


for 
’ 
for 


for ig¢g3d. 


Also, from (25), letting m*t be the (s, t)*® element of M3q , we have 


I J 
= Z m®h +5), + z mh Li. r 
i j E 
h=1 h h=1 h 


* Px; e for 6 = 1,... 
J 
a® +J, “*, a 
h h 
i * Baie 
From (28) and (29) we have 


J J 


a +B a 
E & 
i "on 


J . 
= es . bd be . . . 
(F, “iin *Xiy “ini si) 


J I 
+! @ We , = &€ &,h, - Ow, 
(2, iin PXin ~ yan ips Pig Fi 


= @ sc Bai AE ‘ 
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A corollary of the results of an important paper by Kuhn and Tucker! is that a suffi- 
cient condition for a point X to give minimum V for a set 


Sn {xXlz0u.xX, 2£ 
sn { Bi j o} 
for some Eo is that 
for j <N, and in 4, 
for j ¢ 4, 
for i¢ &, 
for i > m, and in 3, 
and A, 20. If A, > 0,theconstraint E2Epis effective; if Ep were increased, an equally low value 
of V could not be obtained. If A‘ = 0, the point gives minimum V in Ss. In either case the 
point is efficient. 
It will be convenient at times to employ the following relabeling of variables: 
VY = X, for 


‘k ~ "k-Ny for k=N,+1,...,2N,, 


"k ~ ?my+k - 2N, for k= 2N,+1,...,2N,;+m-m,, 


%, = Xk + 2m, - m- 2N, for k= 2N,+m-m,+1,...,2N, + 2m - 2m, ‘ 
Also 
(37) K = 2N, + 2m - 2m, 
and 
(38) x = {the set of k which identify the variables in equation 30)} . 
Thus on any critical line we have 


(39) y, = 0 for ke x 
and a point X is efficient if it is a projection of a point on a critical line with 


(40) ¥,2 0 for k¢ i, 
or 
(41) %, 20 for k=1,...,K. 





124], W. Kuhn and A. W. Tucker, "Nonlinear Programming," in Proceedings of the Second 
Berkeley Symposium on Mathematical Statistics and Probability. 
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5, INTERSECTIONS OF CRITICAL LINES; NON-DEGENERACY CONDITIONS 

In the computing procedure of the next section we move along a critical line until it 
intersects a plane %* 0, k=1,...,K. Then either one row and the corresponding column is 
added to M, or one row and the corresponding column is deleted from M. This raises two 
questions: (1) under what conditions will the matrix obtained by such additions or deletions be 
non-singular, and (2) how should the new inverse be obtained? The latter question will not be 
discussed except to note that#the possession of the old inverse is of great value in obtaining 
the new one, !3 

Concerning the former question, suppose M yy, with 3¢ satisfying (18) and (19), is non- 
singular and thus defines a critical line 4. Suppose 4 intersects (but is not contained in) the 
plane v, = 0, 1< k< K. We distinguish four cases, depending on whether v corresponds to an 
X, ann, aA, or aé: 

1. The deletion of a variable. Suppose 4 intersects a plane X,= 0, j=1,..., N,- 
Suppose that j is deleted from the set | leaving {*. Is M ag* non-singular? We may 





suppose without loss of generality that j= j, and that A jg may therefore be written 


(42) Ayy = (@Aggy) 


aA 
where @ is the column to be deleted. The matrix c 0 ays) has either rank, I or I +1. I it 


has rank I, then 


Cyy 


A 34 
10...0 


is singular. In this case the equations 


have either no solution or an infinity of solutions. Thus if (44) has one solution, i.e., if ~ inter- 
sects x; = 0 (but is not contained in it), M is non-singular and the rank of (* 5 8") is I+ 1; 
1 00 





13This involves procedures similar to those used in removing a variable from a regression 
analysis or modifying a basis in linear programming; e.g., see R. A. Fisher, Statistical Methods 
for Research Workers, p. 164, 10th ed., and R. Dorfman, Activity Analysis of Production and 
Allocation, p. 358. 
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A ag” A gq 
aence the rank of \9 ~/ is at least I. But the rank of \g — g/ = the rank of Ayqx. There- 


fore, the rank of A ag* is I and M ag is non-singular. 
2. The deletion of a constraint. Suppose 4 intersects (but is not contained in) A j= 0 
for i > m,. We may assume i= i, and that 





ro) Ay = tee) 


a 


Agy has rank I, Ayxqy has rank I-1; therefore Myx, is non-singular. 

3. Addition of a variable. Continuing the conventions used above, if A 44 has rank I, 
so has A ag* = (A a a). Therefore M 4g” is non-singular. 

4. Addition of a constraint. If ~ intersects but is not contained in the plane i @ 0, 
i> m, then 








Cy Aggy 


(where a' is the row of coefficients of the new constraint) is non-singular. Therefore 


A 
(2:5) = Ayx has rank I +1 and M 9*4 is non-singular. 


The tracing out of the efficient set is simplified if certain "accidents" do not occur. 
These accidents are described in the following ''non-degeneracy" conditions. The next section 
of this paper presents a computing procedure for deriving the set of efficient points when all 
non-degeneracy conditions hold. In Sections 7-10 these conditions are relaxed. 


CONDITION 1. On no critical line do we have 
+ * nt Ba Ag #0 forké¢ x. 
CONDITION 2. On any given critical line 4 we do not have 


-a@ -a@ 
vk, vk 


= for any k, # k, with B # 0, #0. 
B vk; Bvk, 1 2 vk, 6 vk 





CONDITION 3. E is bounded from above in 8. 


We will let LE stand for "the linear programming problem of maximizing E subject to con- 
straints (1), (2), and (3)." 





f 


~ow TA 
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CONDITION 4. Le has a unique non-degenerate solution. 


Condition 4 implies condition 3. 


6. THE ALGORITHM UNDER CONDITIONS 1 THROUGH 4 
We now assume that conditions 1 through 4 are satisfied. Condition 4 implies that the 
optimum solution to Ly, has:!4 
(a) Exactly m variables X. and &; are not at their lower extreme; 
(b) A 9(1) q(1) (where 3) includes all i with z,= 0 and ¢{) includes all j with X, 
not at its lower limit) has rank equal to the number of its rows; 
(c) There exists "prices" p, and "profitabilities" , such that 


(47) Pp, > 0 if =.= 0 for i=m,+1,...,m, 

(48) Pp = if &;> 0 for i=m,+1,...,m, 

(49) 7% Pj + uj: 

(50) : for j=N,+1,...,N and for x; > 0 j <N,; 
(51) : for x; 0 j<N,. 


The matrix 


(52) Muy) = Soya) gg) 
Ay (1) (1) 


is non-singular and thus defines a critical line 4(1) along which 


Oo 


(53) , = . + (stn) r.E* 


B (1) 
.; _ — a a 
Since “AY 9) (1) . P (1) id Py if * (1) r (1) Satisfy (53) for Xe = 0, then 
x? Oo \ mM 
we m, { *o ‘ ( s) de 
0 
ya) ~ Pg) *E By (1) ° 


for all AE: Thus 40) has 





14The following are corollaries of the basis and pricing theorems of linear programming. 
See, e.g., George B. Dantzig, Alex Orden, Philip Wolfe, ''The Generalized Simplex Method for 
Minimizing a Linear Form under Linear Inequality Restraints,"' Pacific Journal of Mathematics, 
Vol. 5, No. 2, June 1955. 
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0 
x =X 
1 1 
i gd) = * oq) 


0 
r r r 
g(1) = “g(1)* P g(a) “E 
for all AR: From (47) it follows that for sufficiently large Ae 


A, ? 0 for i > my andin 3. 


0 
2 0 0 
ZO, xX, - 2 aij Ai - (Za; Pp; + U)rAE ; 


Equation (51) implies that for sufficiently large AEN; > 0 for j ¢ 4. Thus for sufficiently 
large Ap,t satisfies inequalities (40). 

Let a(t) be the largest value of A, at which 4) intersects a plane ny 0 for jé¢ 
or i= 0 for i€ 3. (The X and = do not vary along 20) If »() < 0 then x? gives mini- 
mum V as well as maximum E. Suppose a (2) > 0. Non-degeneracy condition 2 implies 21) 
intersects only one plane nj= 0 or Ai= 0 at 0 (2), In the former case we add j to 4; in the 


(2) (2) = ‘ 
latter case we delete i from 3, toform 3‘“’, {‘“’. The new matrix Mio) M 9 (2) 4(2) is non 


singular and defines a critical line 4 (2). Suppose for a moment that it was n= 0 which a' 
0 


intersected at nl), On 42) we have at A\,= » (2), 


E 


A, > 0 for i >m, and e g (2) 


for j ¢ (2) ; 


for igi, 


; > 0 for all other j<N, and € (2) ; 


As always %,° a+bdAp along 4(2). Non-degeneracy condition 1 assures b# 0. If b < 0 the 


projection of 4(2) would be efficient for A* > rE 2 @) where A* > nf), This is impossible. !° 
Therefore b > 0 and 4{2) is efficient for (2) 2ARp2 (2) where (2) > (2). Similar remarks 
would apply if g(t) first intersected A; = 0 and ip was deleted from 3. 

0 





I5since b 7 0 the X-projection of the critical line is a line rather than a point. Along this 


line E increases with Ap. If i E? rn were feasible, then E > Ell = max E would be obttain- 
able, which is impossible. 
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2) is the highest value of AR < (2) at which 4(2) intersects a plane v, = 0 for 


k 
k-1,...,K. If this is an nj we again adda j to }. [fitisa A, we delete i from 3; ifa Bis 
we add i to 3; if an Xj we delete j from {. We form M(3) and 4 (3) accordingly and find 

, (3) < (2). This process is repeated until Ap =0 is reached. At each step (s) Ms) is non- 
singular and if v, is the new variable (n, X, A, or £) which is no longer constrained to be 

5 
zero we have at y(8-1)_ 
(58) vy, 7? 0 for k#k, and ¢ x, 


Vv = 0. 
Ke, 


By condition 1, b # 0 along 4{8)_ We argue below!® that we cannot have b < 0. 
vk. vk, 


So ork. > 0 and 4's) is efficient for aoe 2 Ap 2 a(S) where ti > (8), Since there are 
only a finite number of critical lines, and each can satisfy inequalities (40) for only one segment, 


Ap = 0 is reached in a finite number of steps. 


7. THE ALGORITHM UNDER CONDITIONS 3 AND 4 
Let us now drop non-degeneracy conditions 1 and 2 but still assume conditions 3 and 4. 

We will use techniques analogous to the degeneracy-avoiding techniques of linear programming.!7 
For every number e« we define a new problem P(e) as follows: 


ae _ j 
minimize V(e) = Uzi; Xj X; +ZDe Xj 


subject to 


(59) 


(60) 


(61) 





1615 Vk is an Xj or &j, byk, < 0 implies that there are two distinct points which minimize 


V for some E > E(s-1), which is impossible. This argument also applies if v, isa; or nj 
unless the X-projection of the new critical line is a point. In the latter case we note (from the 
Kuhn and Tucker conditions) that an efficient point gives minimum Q( Ag) = V - ARE subject to 
(1), (2), (3). For fixed \E, Q(\ g) has a unigue minimum. If Vv, < 0 then two distinct points 
give minimum Q(\ ¢) for some Ap? h pls- ij. 

In linear programming these techniques are generally not needed in practice. In quad- 
tatric programming arbitrary selection of v, = 0 with byk <0 to go into X may (or may not) 
prove adequate. In any case, the degeneracy-handling techniques are available if needed. See 
George Dantzig, ''Application of the Simplex Method to a Transportation Problem,'' Activity 
Analysis of Production and Allocation, Tjalling C. Koopmans, ed.; A. Charnes, ''Optimality and 
Degeneracy in Linear Programming,'' Econometrica, Vol. 20, No. 2, April, 1952, p. 160; and 
Dantzig, Orden, and Wolfe, Op. Cit. 





391368 O- 56-9 
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For sufficiently small « the unique, optimal basis of Lp is feasible and, since it still satisfies 
the pricing conditions, is optimal. 

As we will see shortly for sufficiently small ¢, P(e) satisfies non-degeneracy condi- 
tions (1) and (2). We will also see that for a sufficiently small ¢*, the sequence of indices 
(3 4)® associated with the critical lines 45), until X= 0 is reached, is the same for all 
P(e) for «* > « >0. If we change indices (3, 4) in the same sequence as P(e) for small ¢, 
if we let AE decrease along any critical line when it can without violating v2 0, until we 
reach Ar = 0, then: 


(a) We will pass through a finite number of index sets each associated with a non- 
singular My, before we reach A E* 0. 

(b) Since % 2 > 0 is maintained we have the desired solution to the original problem. 

Along any critical line of P(e) we have 


x Oo rv 
ite a} ( ) . 
i i (; ) ie. 1 ain 


jy 
+ gl 


g 
® Bas + m 
Xi, “E* no 


i" sh_f(h) 
= °xi, € 


= jy, (2) = jg,...,f(I+J) = N+ i, 


or 
Similarly 


4 


mJ *8sh , £(h) 
*E- h= -" 


= N+i_ 
E,=Q@Es+ Be, “:* 2 a all = @ei+ Be. Ae t Pe, (e) ‘ 


J I 
(66) nyt any + Bn, gt Kg Ry th~ % = 1 igi Pri, (e) +e! 


sani + Bn; AE t+ Pnj (e). 





Cc 


(6 


(6 
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Consider the polynomials: 
(67) Px;( e) for 
(68) P(e) for ied, 
(69) P,j(e) for i¢ 4d, 
(70) pnt) for jx. 
None of the polynomials listed above have all zero coefficients, and no two have proportional 
coefficients. For each polynomial of (69) and (70) has a term with a coefficient of 1 which every 
other polynomial has with a coefficient of zero. This leaves only the possibilities that some 
polynomial of (67) or (68) has all zero coefficients or two of these polynomials have propor- 
tional coefficients. Both these possibilities imply that m7! is singular and therefore are 
impossible. 
Since Py, (©) has only a finite number of roots, for « sufficiently small 
Py, (©) #0 for k ¢ x. 


Thus 


(71) Vic = Wt BE AE + Py, (e) -@<A_< @ 


cannot be identically zero for k ¢ X. The critical line intersects the plane Vv, = 0 at 
1 


Puk, (e) 
B 


(72) 





and the plane 
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then for sufficiently small « 


On the other hand, since 
Pyk, (*) ~ Puke (*) = © Ky> ky # x 
has a finite number of solutions, for sufficiently small « 


' w 
det de 


even if 
-a -a 

vk, vk 

(75) 





B 7 a 
vk vky 


“Pyky (e) 

As «—=> 0 the smallest power of « dominates; i.e., if, say, a has an algebraically 
larger coefficient for the first power of «, then \' > A" as e—> 0. If both have the same 
coefficient of «, then it is the coefficients of e? that decide. And so on. 

Since there are a finite number of critical lines and a finite number of planes v, = 0, 
there is a single «* such that for «* > « >0. 

P(e) satisfies non-degeneracy conditions (1) and (2); and the order of the index sets 
(a q)§ is the same for all such «. 

The m®>. are needed for other purposes and are thus available for resolving degeneracy 
problems. The other coefficients of Py, fe) can be computed when needed. 


8. THE ALGORITHM WHEN L,, IS DEGENERATE BUT UNIQUE 


E 
Suppose that the solution to LE is degenerate in that one or more of the basis variables 

X. or & ; is "accidentally" zero, but is unique in that 6; <0 for all x; not in the basis and 

Pj” 0 for all &; not in the basis. 

, The constraints of Lp may be written as a system of equations including the &, as 

variables: 


x 
(76) p (*) =». 
& 


If B is the submatrix of optimal basis vectors and if Xq and & j are the optimal basis vari- 
ables, then the optimal solution is given by 


x 
(77) 


E 





1eracy 


riables 
nd 
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while all other variables are zero. After we solve LE we may modify it, forming Lp (e) as 
follows: 


for « >0 


h 


where r; is the sum of the it) -ow of B. 


Then 
X q(e) 


z (e) 
3 


Thus the original optimal basis is still feasible and therefore uniquely optimal (since it still 
satisfies the pricing relationships). Also for « > 0 


X,(s) >0 for je 4, 


Ej (e) >0 for ie J, 


E_(e) 20 
I i 


as e——> Q. 


The procedures of the last section which apply when Lp has a unique and non- 
degenerate solution apply with essentially no modification if Lp has a unique but possibly 
degenerate solution, if we let P(e) be 


: a j+1 
min V © 220, 5,4, + Ht X; 
Subject to 


Da... X,=b, +7, 0+ eNtit! 
i ‘th 


jj for i=1,...,m,, 


N+i+1 
Ya Xj 2b +rypere 


j for i=m,+1,...,m. 


The solution to Lp (e) is non-degenerate for sufficiently small ¢. Along any critical line we 
now have 
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I 
s,h+J 
™_* Pxi, AE +e Pxi, (e) + (2, m ri) € 


a 


. a ’ : 
xj “7. E + 4xy, (¢) 5 


I 
J,h+J 
@,, +B); Aptep « -(2 pres ri) 
ri, r1, E ri, h=1 in 
2. o8,, asvt. 46); 
i, Ai, E Ai, 


N+i+1 


J 
@e,+Be; ig* 3 9g te 48 


Oe; +Be; AB+t Ge; (e) 5 


J I 
= : : i+ 
a * Ong Set SS ey * 


=1 


1 


(84) 
Anji + Bn j B+ 4nj Ce) 


where the P, ( e) are as defined in (63) through (66). Since no Py (e) can have zero coefficients 
and no two can have proportional coefficients, the same is true of the qy(e). 


9. THE ALGORITHM WHEN LE IS NOT UNIQUE 


A non-degenerate optimal solution to Ly is unique if, and only if, 


FF <0 for Xj not in the basis 
(85) 
Pi? 0 for bi not in the basis. 


If Le has a degenerate solution and (85) does not hold, then either the solution is not unique or 
else only the optimal basis is not unique. If Lp does not have a unique solution we must find 
the point X which gives minimum V for E =E = max E. If only the optimal basis of Lp is not 
unique we still must decide on the 3¢ of our first critical line. Both these problems will be 
resolved in the same manner. Our procedure may be considered as a special case of either 
approach 1 or approach 4 for minimizing a quadratic subject to linear constraints described in 
Section 12. 

Let us create a new linear programming problem Ly (e) by adding a constraint to and 
modifying the form to be maximized in Ly (e). The equation we add is 


N 


86 . = ests 2.» 
(86) a Hy X; Ep B+ (2) os 1) ec. 
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If we add &,, to the optimum basis variables of Lp (ce) we have a feasible basis corresponding 
to a solution with 


jet, 


ied, 


Next let us replace the objective function E = 2 uw X with a new one 


(88) F=2 vj Xj 
such that the solution in (87) is the unique optimum of Ly (e). This may be done easily by 
assigning any values P; ” 0 toi ¢ 4, P; = 0 for ie 3 as hat aS Pp = 0. Then choose any set 
for Vv. j so that 6.=0 for je ¢ and 6. <0 for j 4 ¢. Since Lp (e) has a unique non-degenerate 
solution we may use methods already described to trace out the set of points which give mini- 
mum V(«) for given F until Ae =0. If only a few bases are feasible for Lp(e), i.e., if not 
too many bases are optimal for LE (e), A F= 0 will be reached quickly. At AF =0 either 

re =0or Ap” > 0. In the former a we have arrived at a point with ON. § V and maxi- 
mum E. In the latter case we have X and are ready to trace out the set of efficient X's. From 
this point on we let APF = 0, i.e., we ignore F completely. Since at Aye = 0, ‘A > 0 for all 
k ¢ X we may reduce Ae until we intersect a plane v= 0 and continue as in Section 8. 


10. THE ALGORITHM, WHEN CONDITION 3 DOES NOT HOLD 

If E is unbounded procedure 4 of Section 12 can be used to find the point X with mini- 
mum V. The efficient set can then be traced out in the direction of increasing AR: Since 
there are only a finite number of critical lines and each critical line is efficient at most once 
the efficient set is traced out in a finite number of steps. 


ll, THE SET OF EFFICIENT E, V COMBINATIONS 

Once the set of efficient X's is found the set of efficient E,V combinations can be 
obtained easily. The critical line of a subspace in which more than one value of E is obtain- 
able may be expressed as the solution to 


(89) 2 Ojn xX, + 2 (-2j) aj; + (-Ap) | = 0, j € ¢ ’ 


9 - 
(90) 2 ay X; 


91 Du. X: 
(91) MX; 


for -om~<E< +0. 


1 


If we let N"~ be the inverse of the matrix N in (89), (90), (91) we have 
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from which it follows that along any such critical line V and E are related by a formula of the 
form 


(94) V =a+ bE+CE?. 


Thus the set of efficient E,V combinations is piecewise parabolic. We know, or can easily 
get, the values of E and dV/dE at the end points of each of the pieces. We can also evaluate 
v at x.!8 Knowing V at one value of E and dV/dE = b + 2CE at two values of E we can 
solve for the a, b, and c in (94) for the segment from E to E - €,- Having a, b, and c we can 
evaluate V at E - ey by means of (94). This provides us with the value of V at one value of 
E on the segment which is efficient from E - ey to E-« 2° This, combined with the values of 
dV/dE at two values of E, allows us to obtain the a, b, c of (94) for this next segment—and so 
on until we trace out the set of E, V combinations. 


12. MINIMIZING A QUADRATIC 

One of the "by-products" of the calculation of efficient sets is the point at which V isa 
minimum, i.e., where A E = 9. The computing procedures described in Sections 6 through 10 
are analogous to the simplex method of linear programming (as contrasted with the "gradient 
methods" that have been suggested for both linear and non-linear programming). Both the 
procedure described in the preceding section—considered as a way of getting to min V—and 
the simplex method require a finite number of iterations, each iteration typically taking a 
"jump" to a new point which is superior to the old. Each iteration makes use of the inverse of 
a matrix which is a "'slight"’ modification of the matrix of the previous iteration. The success 
of the simplex method in linear programming suggests that it may be desirable to use a variant 
of the "critical line’ method in the quadratic case. 

Our problem then is to minimize a quadratic 


V= Uz OG, x; X; 


subject to constraints (1), (2) and (3). We wish to translate this into a problem of tracing out 
an efficient set. This may be done in several ways. 

1. An arbitrary set of “4. can be selected and the efficient set traced out until A 
The Mj should be selected so that the "‘artificial'’’ E has a unique maximum. 

2. An equality, say, 


E= 


yay; x; = by 





1815 X does not exist we can evaluate V at X and use the same process ''in reverse." 
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(3). 


THE OPTIMIZATION OF A QUADRATIC FUNCTION 


can be eliminated from (1). E can be defined as 


E = 2a; x; 


and the critical set traced out until E = by. If E= by is reached before ARF 0 the computing 
procedures of the last section must be continued into the region of 1, < 0. While the points 
thus generated will not be efficient—for they do not give max E for given V—they do give min 
V for given E. In particular, they will arrive at the point of min V for 


3. An inequality, say, 


> amj x; 2 Din 


can be eliminated from (2). E can be defined as 


B= 2 8... %;. 
mj ) 
The efficient set is traced out until either E= Din or else ARF 0. If the former happens first 
the constraint is effective; if the latter happens first the constraint is ineffective. In either 
case, the point associated with the first of these to occur gives min V subject to (1), (2), and 


(3). 


4. An initial guess a ate e - which satisfies (1), (2), and (3) can be made and Mi 
defined so that, given these u., X~ is efficient. The efficient set can then be traced out until 
de =0. Tochoose pt. so that x? is efficient, choose arbitrary positive values of A i (i e 3d 
and Ae: Then choose Mj so that 


nj = 0 for X; not at its lower bound, 


nj > 0 for x; at its lower bound. 


If x? is in the same subspace as the optimal solution, the latter is reached in one iteration. 





19It has been found recently that the strict convexity assumption can be relaxed. The pro- 
cedures described in this paper apply, without modification, to the homogeneous quadratic 
whenever (93) is positive semi-definite. The non-homogeneous quadratic requires a slight 
modification of procedure for the general semi-definite 0j)). (Footnote added in proof. ) 








NEWS AND MEMORANDA 


Professor A. Charnes of the Mathematics Department of Carnegie Institute of Tech- 
nology has been appointed Professor of Mathematics and Industrial Management at Purdue 
University. This is a joint appointment between the Mathematics Department and the new 
School of Industrial Engineering and Management. He has also been named Director of Re- 
search in the latter. 





Dr. W. H. Marlow was appointed Principal Investigator of The George Washington 
University Logistics Research Project on February 1, 1956. During the previous year he was 
associated with Numerical Analysis Research, Department of Mathematics, University of 
California, Los Angeles. 





Dr. M. E. Rose of the Office of Naval Research has been appointed Managing Editor of 
the Naval Research Logistics Quarterly. 


The following appointments to Associate Editor are announced: 


Dr. A. J. Hoffman, National Bureau of Standards 
. S. Karlin, California Institute of Technology 
. W. H. Marlow, George Washington University Logistics Research Project 
. M. Wood, Office of the Secretary of Defense 
. M. A. Geisler, The RAND Corporation 
Captain P. L. Folsom, USN, Staff, Naval War College 





Appreciation is expressed to the following individuals for their valuable services as 
Associate Editors of this journal during their terms of office: Prof. D. Blackwell, Capt. R. M. 
Bowstrom, Dr. G. B. Dantzig, Prof. M. M. Flood, and Cdr. H. Strock. 





The Second Annual Statistical Engineering Symposium sponsored by the Chemical Corps 
Engineering Agency will be held at the Army Chemical Center, Maryland on April 26 and 27, 
1956. 





A Symposium for Management of Industrial Applications of Analog Computers, spon- 
sored by the Midwest Research Institute will be held on April 10 and 11, 1956, at the Hotel 
Phillips, Kansas City, Missouri. 








NEWS AND MEMORANDA 


The Fourth Annual Meeting of the Operations Research Society of America will be held 
in Washington, D. C., on May 10 and 11, 1956, at the Sheraton-Park Hotel. The program will 
consist of invited addresses and sessions for both invited and contributed papers. President 
LeRoy A. Brothers will give his retiring address at a banquet on Thursday evening, May 10. 
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RECENT PUBLICATIONS 


THE DIRECTION OF WAR by Air Vice-Marshall Edward J. Kingston-McCloughry, 
R.A.F. Frederick A. Praeger, Inc. New York, 261 pp. 


This book is subtitled ''A Critique of the Political Direction and High Command in War" 
and according to the author is the first such essay written on the subject from an inter-Service 
and inter-Allied approach. Air Vice-Marshall Kingston-McCloughry writes out of his experi- 
ences in a wide variety of high command positions. The student of organization theory will 
find this volume particularly useful with respect to the organization of high command and the 
influence of personality on any particular organization. The author feels that it is important 
to evaluate the systems and personalities involved in high command because of the appalling 
losses in manhood and material that are caused by mistaken political direction and High Com- 
mand. By the very nature of things, such high level staffs do not write their own accounts for 
publication critically and impartially. This, then, is the author's attempt to reveal the factors 
lying behind high command decisions and the efficacy of various organizations and personalities 
to make proper decisions. 


MERCHANT SHIPPING AND THE DEMANDS OF WAR by C. B.A. Behrens. London, 
Her Majesty's Stationery Office, 1955, 494 pp. 


One of the Official British Civil Histories of the Second World War, this book is con- 
cerned with the problem of planning for war shipping requirements in the United Kingdom. It 
presents a thoroughly documented and detailed account of how successful the control of ship- 


ping in war-time was as the result of collaboration between the Ministry of War Transport, 
civilian claimants, and the Services. In short, the text ably portrays that though the organiza- 
tion that controls merchant ships can do nothing directly to win a war, it can very easily cause 
one to be lost. Despite the vast amount of detail which is magnified by numerous appendices, 
statistical in nature, this is a story that needs to be told. Its value to the student lies in the 
collecting of a great amount of research material into one volume for ready, though not too 
readable, assimilation. The author makes some interesting observations concerning British 
dealings with the Americans and, more particularly, some of the "shortcomings" of American 
planning in the War Shipping Administration. The text is supplemented with pictures and illus- 
trations, and the topic and chapter headings make it useful as a reference work. 


WORLD COMMERCE AND GOVERNMENTS: TRENDS AND OUTLOOK by W.S. & 
E.S. Woytinsky. New York, The Twentieth Century Fund, 1955, 907 pp. 

A sequel to WORLD POPULATION AND PRODUCTION, this is a valuable reference 
work. It is divided into three main parts: Trade, Transportation, and Governments. The 


consideration of each subject begins with an historical development which is carried to the 
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present. Containing many tables of well-substantiated comparative figures, it is not only a 
valuable source of statistical information but contains the background information required for 
its proper understanding. 


CAPITAL FORMATION AND ECONOMIC GROWTH edited by Moses Abramovitz. 
Published for the National Bureau of Economic Research by Princeton University Press, 1955, 
pp. xiii+ 677. 


This volume contains the papers presented at the Conference on Capital Formation and 
Economic Growth which met in New York, November 1953, under the auspices of the Universities. 
National Bureau Committee for Economic Research. The volume also includes discussion papers 
prepared at the invitation of the Conference Committee and contributions submitted by members 
of the Conference. The authors include economists, historians, and a sociologist. Simon 
Kuznets and Raymond Goldsmith examine the sources and channels of finance in capitalist 
nations. Gregory Grossman and F. D. Holzman analyze the experience of the Soviet Union. 

Bert Hoselitz and Thomas Cochran consider the effects of entrepreneurship and business organ- 
izations on capital formation in Britain, France, and the United States. Henry Aubrey and 
Marion Levy discuss the importance of the same factors in underdeveloped areas. Abbott 
Payson Usher and W. Rupert Maclaurin relate invention and innovation to investment, while 
Adolph Lowe uses a series of models to analyze the physical composition of investment required 
for balanced growth. W. W. Rostow sums up the contributions and suggests further points for 


study. In addition, Moses Abramovitz has written an introduction to the study of capital 
formation. 


THE ELEMENTS OF PROBABILITY THEORY AND SOME OF ITS APPLICATIONS 
by Harald Cramer. New York: John Wiley and Sons, Inc., 1955, 281 pp. 


This book is a revised and extended translation of a Swedish textbook first published in 
1926 and rewritten in 1949. The book is by the author of the famous work entitled MATHE- 
MATICAL METHODS OF STATISTICS, published by Princeton University Press in 1946. The 
work is of an elementary level and requires that the reader have only some working knowledge 
of analytical geometry, calculus, and algebra. The author believes that the book could be read 
without difficulty by a student at the junior level in an ordinary American college. There are 
three parts. The first deals with foundations, giving the principal theorems for probability and 
definitions of terms used in the later part. The second part discusses random variables and 
probability distribution, including the chi square distribution. The third part brings applica- 
tions mostly to statistics, in particular to sampling distribution and the problems of statistical 
inference. Theorems are proved as far as possible, but where the proofs would be too difficult 
the reader is referred to the more advanced literature which is always carefully indicated. 
Many examples and exercises are provided. There are long sections which are non-mathematical 
and which could serve for those readers who do not wish to work their way through all parts of 
the book, yet they would obtain a reasonable understanding of the principal notions of probability 
theory. 
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HARMONIC ANALYSIS AND THE THEORY OF PROBABILITY by Salomon Bochner. 
University of California Press, 1955, 176 pp. 


In this volume the author ties together and expands upon a wide variety of advanced 
topics in Fourier analysis with finitely and infinitely many variables and in the theory of prob- 
ability, exhibiting some of the very intimate connections between the two fields. Many of the 
author's results of recent years have been expanded upon and their interrelations further 
explored; some results appear for the first time. The topics taken up include: Kernel- 
approximation theory in finitely many variables; Fourier expansions in finite or infinite dimen- 
sions; closure properties of the Fourier transform; Laplace and Mellin transforms and the 
subordination of certain stochastic processes; characteristic functionals; and an analysis of 
expansions and convergence in stochastic processes. 


INTRODUCTION TO MATHEMATICAL STATISTICS by Paul G. Hoel. New York: John 
Wiley and Sons, Inc., 2nd edition, 1954, pp. xi + 331. 


This textbook on mathematical statistics is a rather extensive revision of the first edi- 
tion of the author's well-known book. The second edition places more emphasis on the basic 
theory of statistics, but the material is presented so that the reader needs only a sound back- 
ground in elementary calculus to understand the theoretical developments. A new chapter on 
probability has been added and other chapters have been completely rewritten or enlarged. 

The chapters on correlation and regression have been rewritten to place greater emphasis on 


regression. The material on the analysis of variance has been rewritten and expanded consid- 
erably. The chapter on nonparametric methods also has been expanded. Finally, a large num- 
ber of exercises have been added to the chapters. 
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